Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act)
(Text with EEA relevance)
[Link to official publication] | [Access Full List of Defined Terms]
THE EUROPEAN PARLIAMENT AND THE COUNCIL OF THE EUROPEAN UNION,
Having regard to the Treaty on the Functioning of the European Union, and in particular Articles 16 and 114 thereof,
Having regard to the proposal from the European Commission,
After transmission of the draft legislative act to the national parliaments,
Having regard to the opinion of the European Economic and Social Committee (OJ C 517, 22.12.2021, p. 56.),
Having regard to the opinion of the European Central Bank (OJ C 115, 11.3.2022, p. 5.),
Having regard to the opinion of the Committee of the Regions (OJ C 97, 28.2.2022, p. 60.),
Acting in accordance with the ordinary legislative procedure (Position of the European Parliament of 13 March 2024 (not yet published in the Official Journal) and decision of the Council of 21 May 2024),
Whereas:
(1) The purpose of this Regulation is to improve the functioning of the internal market by laying down a uniform legal framework in particular for the development, the placing on the market, the putting into service and the use of artificial intelligence systems (Error! Post not found for word:ai systems) in the Union, in accordance with Union values, to promote the uptake of human centric and trustworthy artificial intelligence (AI) while ensuring a high level of protection of health, safety, fundamental rights as enshrined in the Charter of Fundamental Rights of the European Union (the ‘Charter’), including democracy, the rule of law and environmental protection, to protect against the harmful effects of Error! Post not found for word:ai systems in the Union, and to support innovation. This Regulation ensures the free movement, cross-border, of AI-based goods and services, thus preventing Member States from imposing restrictions on the development, marketing and use of Error! Post not found for word:ai systems, unless explicitly authorised by this Regulation.
(2) This Regulation should be applied in accordance with the values of the Union enshrined as in the Charter, facilitating the protection of natural persons, Error! Post not found for word:undertakings, democracy, the rule of law and environmental protection, while boosting innovation and employment and making the Union a leader in the uptake of trustworthy AI.
(3) Error! Post not found for word:ai systems can be easily deployed in a large variety of sectors of the economy and many parts of society, including across borders, and can easily circulate throughout the Union. Certain Member States have already explored the adoption of national rules to ensure that AI is trustworthy and safe and is developed and used in accordance with fundamental rights obligations. Diverging national rules may lead to the fragmentation of the internal market and may decrease legal certainty for Error! Post not found for word:operators that develop, import or use Error! Post not found for word:ai systems. A consistent and high level of protection throughout the Union should therefore be ensured in order to achieve trustworthy AI, while divergences hampering the free circulation, innovation, deployment and the uptake of Error! Post not found for word:ai systems and related products and services within the internal market should be prevented by laying down uniform obligations for Error! Post not found for word:operators and guaranteeing the uniform protection of overriding reasons of public interest and of rights of persons throughout the internal market on the basis of Article 114 of the Treaty on the Functioning of the European Union (TFEU). To the extent that this Regulation contains specific rules on the protection of individuals with regard to the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data concerning restrictions of the use of Error! Post not found for word:ai systems for remote biometric identification for the purpose of Error! Post not found for word:law enforcement, of the use of Error! Post not found for word:ai systems for Error! Post not found for word:risk assessments of natural persons for the purpose of Error! Post not found for word:law enforcement and of the use of Error! Post not found for word:ai systems of biometric categorisation for the purpose of Error! Post not found for word:law enforcement, it is appropriate to base this Regulation, in so far as those specific rules are concerned, on Article 16 TFEU. In light of those specific rules and the recourse to Article 16 TFEU, it is appropriate to consult the European Error! Post not found for word:data Protection Board.
(4) AI is a fast evolving family of technologies that contributes to a wide array of economic, environmental and societal benefits across the entire spectrum of industries and social activities. By improving prediction, optimising operations and resource allocation, and personalising digital solutions available for individuals and organisations, the use of AI can provide key competitive advantages to Error! Post not found for word:undertakings and support socially and environmentally beneficial outcomes, for example in healthcare, agriculture, food safety, education and training, media, sports, culture, infrastructure management, energy, transport and logistics, public services, security, justice, resource and energy efficiency, environmental monitoring, the conservation and restoration of biodiversity and ecosystems and climate change mitigation and adaptation.
(5) At the same time, depending on the circumstances regarding its specific application, use, and level of technological development, AI may generate risks and cause harm to public interests and fundamental rights that are protected by Union law. Such harm might be material or immaterial, including physical, psychological, societal or economic harm.
(6) Given the major impact that AI can have on society and the need to build trust, it is vital for AI and its regulatory framework to be developed in accordance with Union values as enshrined in Article 2 of the Treaty on European Union (TEU), the fundamental rights and freedoms enshrined in the Treaties and, pursuant to Article 6 TEU, the Charter. As a prerequisite, AI should be a human-centric technology. It should serve as a tool for people, with the ultimate aim of increasing human well-being.
(7) In order to ensure a consistent and high level of protection of public interests as regards health, safety and fundamental rights, common rules for high-Error! Post not found for word:risk Error! Post not found for word:ai systems should be established. Those rules should be consistent with the Charter, non-discriminatory and in line with the Union’s international trade commitments. They should also take into account the European Declaration on Digital Rights and Principles for the Digital Decade and the Ethics guidelines for trustworthy AI of the High-Level Expert Group on Artificial Intelligence (AI HLEG).
(8) A Union legal framework laying down harmonised rules on AI is therefore needed to foster the development, use and uptake of AI in the internal market that at the same time meets a high level of protection of public interests, such as health and safety and the protection of fundamental rights, including democracy, the rule of law and environmental protection as recognised and protected by Union law. To achieve that objective, rules regulating the placing on the market, the putting into service and the use of certain Error! Post not found for word:ai systems should be laid down, thus ensuring the smooth functioning of the internal market and allowing those systems to benefit from the principle of free movement of goods and services. Those rules should be clear and robust in protecting fundamental rights, supportive of new innovative solutions, enabling a European ecosystem of public and private actors creating Error! Post not found for word:ai systems in line with Union values and unlocking the potential of the digital transformation across all regions of the Union. By laying down those rules as well as measures in support of innovation with a particular focus on small and medium enterprises (SMEs), including startups, this Regulation supports the objective of promoting the European human-centric approach to AI and being a global leader in the development of secure, trustworthy and ethical AI as stated by the European Council (European Council, Special meeting of the European Council (1 and 2 October 2020) — Conclusions, EUCO 13/20, 2020, p. 6.), and it ensures the protection of ethical principles, as specifically requested by the European Parliament (European Parliament resolution of 20 October 2020 with recommendations to the Commission on a framework of ethical aspects of artificial intelligence, robotics and related technologies, 2020/2012(INL)).
(9) Harmonised rules applicable to the placing on the market, the putting into service and the use of high-Error! Post not found for word:risk Error! Post not found for word:ai systems should be laid down consistently with Regulation (EC) No 765/2008 of the European Parliament and of the Council (Regulation (EC) No 765/2008 of the European Parliament and of the Council of 9 July 2008 setting out the requirements for accreditation and repealing Regulation (EEC) No 339/93 (OJ L 218, 13.8.2008, p. 30).), Decision No 768/2008/EC of the European Parliament and of the Council (Decision No 768/2008/EC of the European Parliament and of the Council of 9 July 2008 on a common framework for the marketing of products, and repealing Council Decision 93/465/EEC (OJ L 218, 13.8.2008, p. 82)) and Regulation (EU) 2019/1020 of the European Parliament and of the Council (Regulation (EU) 2019/1020 of the European Parliament and of the Council of 20 June 2019 on market surveillance and compliance of products and amending Directive 2004/42/EC and Regulations (EC) No 765/2008 and (EU) No 305/2011 (OJ L 169, 25.6.2019, p. 1).) (‘New Legislative Framework’). The harmonised rules laid down in this Regulation should apply across sectors and, in line with the New Legislative Framework, should be without prejudice to existing Union law, in particular on Error! Post not found for word:data protection, Error! Post not found for word:consumer protection, fundamental rights, employment, and protection of workers, and product safety, to which this Regulation is complementary.
As a consequence all rights and remedies provided for by such Union law to consumers, and other persons on whom Error! Post not found for word:ai systems may have a negative impact, including as regards the compensation of possible damages pursuant to Council Directive 85/374/EEC(11) remain unaffected and fully applicable. Furthermore, in the context of employment and protection of workers, this Regulation should therefore not affect Union law on social policy and national labour law, in compliance with Union law, concerning employment and working conditions, including health and safety at work and the relationship between employers and workers. This Regulation should also not affect the exercise of fundamental rights as recognised in the Member States and at Union level, including the right or freedom to strike or to take other action covered by the specific industrial relations systems in Member States as well as the right to negotiate, to conclude and enforce collective agreements or to take collective action in accordance with national law.
This Regulation should not affect the provisions aiming to improve working conditions in platform work laid down in a Directive of the European Parliament and of the Council on improving working conditions in platform work. Moreover, this Regulation aims to strengthen the effectiveness of such existing rights and remedies by establishing specific requirements and obligations, including in respect of the transparency, technical documentation and record-keeping of Error! Post not found for word:ai systems. Furthermore, the obligations placed on various Error! Post not found for word:operators involved in the AI value chain under this Regulation should apply without prejudice to national law, in compliance with Union law, having the effect of limiting the use of certain Error! Post not found for word:ai systems where such law falls outside the scope of this Regulation or pursues legitimate public interest objectives other than those pursued by this Regulation. For example, national labour law and law on the protection of minors, namely persons below the age of 18, taking into account the UNCRC General Comment No 25 (2021) on children’s rights in relation to the digital environment, insofar as they are not specific to Error! Post not found for word:ai systems and pursue other legitimate public interest objectives, should not be affected by this Regulation.
(10) The fundamental right to the protection of Error! Post not found for word:personal Error! Post not found for word:data is safeguarded in particular by Regulations (EU) 2016/679(14) and (EU) 2018/1725(15) of the European Parliament and of the Council and Directive (EU) 2016/680 of the European Parliament and of the Council(16). Directive 2002/58/EC of the European Parliament and of the Council(17) additionally protects private life and the confidentiality of communications, including by way of providing conditions for any storing of personal and Error! Post not found for word:non\-personal Error! Post not found for word:data in and access from terminal equipment. Those Union legal acts provide the basis for sustainable and responsible Error! Post not found for word:data Error! Post not found for word:processing, including where Error! Post not found for word:data sets include a mix of personal and Error! Post not found for word:non\-personal Error! Post not found for word:data. This Regulation does not seek to affect the application of existing Union law governing the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data, including the tasks and powers of the independent supervisory authorities competent to monitor compliance with those instruments.
It also does not affect the obligations of Error! Post not found for word:providers and Error! Post not found for word:deployers of Error! Post not found for word:ai systems in their role as Error! Post not found for word:data Error! Post not found for word:controllers or Error! Post not found for word:processors stemming from Union or national law on the protection of Error! Post not found for word:personal Error! Post not found for word:data in so far as the design, the development or the use of Error! Post not found for word:ai systems involves the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data. It is also appropriate to clarify that Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects continue to enjoy all the rights and guarantees awarded to them by such Union law, including the rights related to solely automated individual decision-making, including Error! Post not found for word:profiling. Harmonised rules for the placing on the market, the putting into service and the use of Error! Post not found for word:ai systems established under this Regulation should facilitate the effective implementation and enable the exercise of the Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects’ rights and other remedies guaranteed under Union law on the protection of Error! Post not found for word:personal Error! Post not found for word:data and of other fundamental rights.
(11) This Regulation should be without prejudice to the provisions regarding the liability of Error! Post not found for word:providers of intermediary services as set out in Regulation (EU) 2022/2065) of the European Parliament and of the Council (Regulation (EU) 2022/2065 of the European Parliament and of the Council of 19 October 2022 on a Single Market For Error! Post not found for word:digital services and amending Directive 2000/31/EC (Error! Post not found for word:digital services Act) (OJ L 277, 27.10.2022, p. 1)).
(12) The notion of ‘Error! Post not found for word:ai system’ in this Regulation should be clearly defined and should be closely aligned with the work of international organisations working on AI to ensure legal certainty, facilitate international convergence and wide acceptance, while providing the flexibility to accommodate the rapid technological developments in this field. Moreover, the definition should be based on key characteristics of Error! Post not found for word:ai systems that distinguish it from simpler traditional Error! Post not found for word:software systems or programming approaches and should not cover systems that are based on the rules defined solely by natural persons to automatically execute operations. A key characteristic of Error! Post not found for word:ai systems is their capability to infer. This capability to infer refers to the process of obtaining the outputs, such as predictions, content, recommendations, or decisions, which can influence physical and virtual environments, and to a capability of Error! Post not found for word:ai systems to derive models or algorithms, or both, from inputs or Error! Post not found for word:data. The techniques that enable inference while building an Error! Post not found for word:ai system include machine learning approaches that learn from Error! Post not found for word:data how to achieve certain objectives, and logic- and knowledge-based approaches that infer from encoded knowledge or symbolic representation of the task to be solved. The capacity of an Error! Post not found for word:ai system to infer transcends basic Error! Post not found for word:data Error! Post not found for word:processing, by enabling learning, reasoning or modelling. The term ‘machine-based’ refers to the fact that Error! Post not found for word:ai systems run on machines.
The reference to explicit or implicit objectives underscores that Error! Post not found for word:ai systems can operate according to explicit defined objectives or to implicit objectives. The objectives of the Error! Post not found for word:ai system may be different from the Error! Post not found for word:intended purpose of the Error! Post not found for word:ai system in a specific context. For the purposes of this Regulation, environments should be understood to be the contexts in which the Error! Post not found for word:ai systems operate, whereas outputs generated by the Error! Post not found for word:ai system reflect different functions performed by Error! Post not found for word:ai systems and include predictions, content, recommendations or decisions. Error! Post not found for word:ai systems are designed to operate with varying levels of autonomy, meaning that they have some degree of independence of actions from human involvement and of capabilities to operate without human intervention. The adaptiveness that an Error! Post not found for word:ai system could exhibit after deployment, refers to self-learning capabilities, allowing the system to change while in use. Error! Post not found for word:ai systems can be used on a stand-alone basis or as a Error! Post not found for word:component of a product, irrespective of whether the system is physically integrated into the product (embedded) or serves the functionality of the product without being integrated therein (non-embedded).
(13) The notion of ‘Error! Post not found for word:deployer’ referred to in this Regulation should be interpreted as any natural or legal person, including a public authority, agency or other body, using an Error! Post not found for word:ai system under its authority, except where the Error! Post not found for word:ai system is used in the course of a personal non-professional activity. Depending on the type of Error! Post not found for word:ai system, the use of the system may affect persons other than the Error! Post not found for word:deployer.
(14) The notion of ‘Error! Post not found for word:biometric Error! Post not found for word:data’ used in this Regulation should be interpreted in light of the notion of Error! Post not found for word:biometric Error! Post not found for word:data as defined in Article 4, point (14) of Regulation (EU) 2016/679, Article 3, point (18) of Regulation (EU) 2018/1725 and Article 3, point (13) of Directive (EU) 2016/680. Error! Post not found for word:biometric Error! Post not found for word:data can allow for the authentication, identification or categorisation of natural persons and for the recognition of emotions of natural persons.
(15) The notion of ‘biometric identification’ referred to in this Regulation should be defined as the automated recognition of physical, physiological and behavioural human features such as the face, eye movement, body shape, voice, prosody, gait, posture, heart rate, blood pressure, odour, keystrokes characteristics, for the purpose of establishing an individual’s identity by comparing Error! Post not found for word:biometric Error! Post not found for word:data of that individual to stored Error! Post not found for word:biometric Error! Post not found for word:data of individuals in a reference database, irrespective of whether the individual has given its Error! Post not found for word:consent or not. This excludes Error! Post not found for word:ai systems intended to be used for biometric verification, which includes authentication, whose sole purpose is to confirm that a specific natural person is the person he or she claims to be and to confirm the identity of a natural person for the sole purpose of having access to a service, unlocking a device or having security access to premises.
(16) The notion of ‘biometric categorisation’ referred to in this Regulation should be defined as assigning natural persons to specific categories on the basis of their Error! Post not found for word:biometric Error! Post not found for word:data. Such specific categories can relate to aspects such as sex, age, hair colour, eye colour, tattoos, behavioural or personality traits, language, religion, membership of a national minority, sexual or political orientation. This does not include biometric categorisation systems that are a purely ancillary feature intrinsically linked to another commercial service meaning that the feature cannot, for objective technical reasons, be used without the principal service and the integration of that feature or functionality is not a means to circumvent the applicability of the rules of this Regulation. For example, filters categorising facial or body features used on online marketplaces could constitute such an ancillary feature as they can be used only in relation to the principal service which consists in selling a product by allowing the Error! Post not found for word:consumer to preview the display of the product on him or herself and help the Error! Post not found for word:consumer to make a purchase decision. Filters used on online social network services which categorise facial or body features to allow users to add or modify pictures or videos could also be considered to be ancillary feature as such filter cannot be used without the principal service of the social network services consisting in the sharing of content online.
(17) The notion of ‘remote biometric identification system’ referred to in this Regulation should be defined functionally, as an Error! Post not found for word:ai system intended for the identification of natural persons without their active involvement, typically at a distance, through the comparison of a person’s Error! Post not found for word:biometric Error! Post not found for word:data with the Error! Post not found for word:biometric Error! Post not found for word:data contained in a reference database, irrespectively of the particular technology, processes or types of Error! Post not found for word:biometric Error! Post not found for word:data used. Such remote biometric identification systems are typically used to perceive multiple persons or their behaviour simultaneously in order to facilitate significantly the identification of natural persons without their active involvement. This excludes Error! Post not found for word:ai systems intended to be used for biometric verification, which includes authentication, the sole purpose of which is to confirm that a specific natural person is the person he or she claims to be and to confirm the identity of a natural person for the sole purpose of having access to a service, unlocking a device or having security access to premises. That exclusion is justified by the fact that such systems are likely to have a minor impact on fundamental rights of natural persons compared to the remote biometric identification systems which may be used for the Error! Post not found for word:processing of the Error! Post not found for word:biometric Error! Post not found for word:data of a large number of persons without their active involvement. In the case of ‘real-time’ systems, the capturing of the Error! Post not found for word:biometric Error! Post not found for word:data, the comparison and the identification occur all instantaneously, near-instantaneously or in any event without a significant delay. In this regard, there should be no scope for circumventing the rules of this Regulation on the ‘real-time’ use of the Error! Post not found for word:ai systems concerned by providing for minor delays. ‘Real-time’ systems involve the use of ‘live’ or ‘near-live’ material, such as video footage, generated by a camera or other device with similar functionality. In the case of ‘post’ systems, in contrast, the Error! Post not found for word:biometric Error! Post not found for word:data has already been captured and the comparison and identification occur only after a significant delay. This involves material, such as pictures or video footage generated by closed circuit television cameras or private devices, which has been generated before the use of the system in respect of the natural persons concerned.
(18) The notion of ‘emotion recognition system’ referred to in this Regulation should be defined as an Error! Post not found for word:ai system for the purpose of identifying or inferring emotions or intentions of natural persons on the basis of their Error! Post not found for word:biometric Error! Post not found for word:data. The notion refers to emotions or intentions such as happiness, sadness, anger, surprise, disgust, embarrassment, excitement, shame, contempt, satisfaction and amusement. It does not include physical states, such as pain or fatigue, including, for example systems used in detecting the state of fatigue of professional pilots or drivers for the purpose of preventing accidents. This does also not include the mere detection of readily apparent expressions, gestures or movements, unless they are used for identifying or inferring emotions. Those expressions can be basic facial expressions, such as a frown or a smile, or gestures such as the movement of hands, arms or head, or characteristics of a person’s voice, such as a raised voice or whispering.
(19) For the purposes of this Regulation the notion of ‘publicly accessible space’ should be understood as referring to any physical space that is accessible to an undetermined number of natural persons, and irrespective of whether the space in question is privately or publicly owned, irrespective of the activity for which the space may be used, such as for commerce, for example, shops, restaurants, cafés; for services, for example, banks, professional activities, hospitality; for sport, for example, swimming pools, gyms, stadiums; for transport, for example, bus, metro and railway stations, airports, means of transport; for entertainment, for example, cinemas, theatres, museums, concert and conference halls; or for leisure or otherwise, for example, public roads and squares, parks, forests, playgrounds. A space should also be classified as being publicly accessible if, regardless of potential capacity or security restrictions, access is Error! Post not found for word:subject to certain predetermined conditions, which can be fulfilled by an undetermined number of persons, such as the purchase of a ticket or title of transport, prior registration or having a certain age. In contrast, a space should not be considered to be publicly accessible if access is limited to specific and defined natural persons through either Union or national law directly related to public safety or security or through the clear manifestation of will by the person having the relevant authority over the space. The factual possibility of access alone, such as an unlocked door or an open gate in a fence, does not imply that the space is publicly accessible in the presence of indications or circumstances suggesting the contrary, such as. signs prohibiting or restricting access. Company and factory premises, as well as offices and workplaces that are intended to be accessed only by relevant employees and service Error! Post not found for word:providers, are spaces that are not publicly accessible. Publicly accessible spaces should not include prisons or border control. Some other spaces may comprise both publicly accessible and non-publicly accessible spaces, such as the hallway of a private residential building necessary to access a doctor’s office or an airport. Online spaces are not covered, as they are not physical spaces. Whether a given space is accessible to the public should however be determined on a case-by-case basis, having regard to the specificities of the individual situation at hand.
(20) In order to obtain the greatest benefits from Error! Post not found for word:ai systems while protecting fundamental rights, health and safety and to enable democratic control, Error! Post not found for word:ai literacy should equip Error! Post not found for word:providers, Error! Post not found for word:deployers and affected persons with the necessary notions to make informed decisions regarding Error! Post not found for word:ai systems. Those notions may vary with regard to the relevant context and can include understanding the correct application of technical elements during the Error! Post not found for word:ai system’s development phase, the measures to be applied during its use, the suitable ways in which to interpret the Error! Post not found for word:ai system’s output, and, in the case of affected persons, the knowledge necessary to understand how decisions taken with the assistance of AI will have an impact on them. In the context of the application this Regulation, Error! Post not found for word:ai literacy should provide all relevant actors in the AI value chain with the insights required to ensure the appropriate compliance and its correct enforcement. Furthermore, the wide implementation of Error! Post not found for word:ai literacy measures and the introduction of appropriate follow-up actions could contribute to improving working conditions and ultimately sustain the consolidation, and innovation path of trustworthy AI in the Union. The European Artificial Intelligence Board (the ‘Board’) should support the Commission, to promote Error! Post not found for word:ai literacy tools, public awareness and understanding of the benefits, risks, safeguards, rights and obligations in relation to the use of Error! Post not found for word:ai systems. In cooperation with the relevant stakeholders, the Commission and the Member States should facilitate the drawing up of voluntary Error! Post not found for word:codes of conduct to advance Error! Post not found for word:ai literacy among persons dealing with the development, operation and use of AI.
(21) In order to ensure a level playing field and an effective protection of rights and freedoms of individuals across the Union, the rules established by this Regulation should apply to Error! Post not found for word:providers of Error! Post not found for word:ai systems in a non-discriminatory manner, irrespective of whether they are established within the Union or in a third country, and to Error! Post not found for word:deployers of Error! Post not found for word:ai systems established within the Union.
(22) In light of their digital nature, certain Error! Post not found for word:ai systems should fall within the scope of this Regulation even when they are not placed on the market, put into service, or used in the Union. This is the case, for example, where an Error! Post not found for word:operator established in the Union contracts certain services to an Error! Post not found for word:operator established in a third country in relation to an activity to be performed by an Error! Post not found for word:ai system that would qualify as high-Error! Post not found for word:risk. In those circumstances, the Error! Post not found for word:ai system used in a third country by the Error! Post not found for word:operator could process Error! Post not found for word:data lawfully collected in and transferred from the Union, and provide to the contracting Error! Post not found for word:operator in the Union the output of that Error! Post not found for word:ai system resulting from that Error! Post not found for word:processing, without that Error! Post not found for word:ai system being placed on the market, put into service or used in the Union. To prevent the circumvention of this Regulation and to ensure an effective protection of natural persons located in the Union, this Regulation should also apply to Error! Post not found for word:providers and Error! Post not found for word:deployers of Error! Post not found for word:ai systems that are established in a third country, to the extent the output produced by those systems is intended to be used in the Union.
Nonetheless, to take into account existing arrangements and special needs for future cooperation with foreign partners with whom information and evidence is exchanged, this Regulation should not apply to public authorities of a third country and international organisations when acting in the framework of cooperation or international agreements concluded at Union or national level for Error! Post not found for word:law enforcement and judicial cooperation with the Union or the Member States, provided that the relevant third country or international organisation provides adequate safeguards with respect to the protection of fundamental rights and freedoms of individuals. Where relevant, this may cover activities of entities entrusted by the third countries to carry out specific tasks in support of such Error! Post not found for word:law enforcement and judicial cooperation. Such framework for cooperation or agreements have been established bilaterally between Member States and third countries or between the European Union, Europol and other Union agencies and third countries and international organisations. The authorities competent for supervision of the Error! Post not found for word:law enforcement and judicial authorities under this Regulation should assess whether those frameworks for cooperation or international agreements include adequate safeguards with respect to the protection of fundamental rights and freedoms of individuals. Error! Post not found for word:recipient national authorities and Union institutions, bodies, offices and agencies making use of such outputs in the Union remain accountable to ensure their use complies with Union law. When those international agreements are revised or new ones are concluded in the future, the contracting parties should make utmost efforts to align those agreements with the requirements of this Regulation.
(23) This Regulation should also apply to Union institutions, bodies, offices and agencies when acting as a Error! Post not found for word:provider or Error! Post not found for word:deployer of an Error! Post not found for word:ai system.
(24) If, and insofar as, Error! Post not found for word:ai systems are placed on the market, put into service, or used with or without modification of such systems for military, defence or national security purposes, those should be excluded from the scope of this Regulation regardless of which type of entity is carrying out those activities, such as whether it is a public or private entity. As regards military and defence purposes, such exclusion is justified both by Article 4(2) TEU and by the specificities of the Member States’ and the common Union defence policy covered by Chapter 2 of Title V TEU that are Error! Post not found for word:subject to public international law, which is therefore the more appropriate legal framework for the regulation of Error! Post not found for word:ai systems in the context of the use of lethal force and other Error! Post not found for word:ai systems in the context of military and defence activities. As regards national security purposes, the exclusion is justified both by the fact that national security remains the sole responsibility of Member States in accordance with Article 4(2) TEU and by the specific nature and operational needs of national security activities and specific national rules applicable to those activities. Nonetheless, if an Error! Post not found for word:ai system developed, placed on the market, put into service or used for military, defence or national security purposes is used outside those temporarily or permanently for other purposes, for example, civilian or humanitarian purposes, Error! Post not found for word:law enforcement or public security purposes, such a system would fall within the scope of this Regulation.
In that case, the entity using the Error! Post not found for word:ai system for other than military, defence or national security purposes should ensure the compliance of the Error! Post not found for word:ai system with this Regulation, unless the system is already compliant with this Regulation. Error! Post not found for word:ai systems placed on the market or put into service for an excluded purpose, namely military, defence or national security, and one or more non-excluded purposes, such as civilian purposes or Error! Post not found for word:law enforcement, fall within the scope of this Regulation and Error! Post not found for word:providers of those systems should ensure compliance with this Regulation. In those cases, the fact that an Error! Post not found for word:ai system may fall within the scope of this Regulation should not affect the possibility of entities carrying out national security, defence and military activities, regardless of the type of entity carrying out those activities, to use Error! Post not found for word:ai systems for national security, military and defence purposes, the use of which is excluded from the scope of this Regulation. An Error! Post not found for word:ai system placed on the market for civilian or Error! Post not found for word:law enforcement purposes which is used with or without modification for military, defence or national security purposes should not fall within the scope of this Regulation, regardless of the type of entity carrying out those activities.
(25) This Regulation should support innovation, should respect freedom of science, and should not undermine research and development activity. It is therefore necessary to exclude from its scope Error! Post not found for word:ai systems and models specifically developed and put into service for the sole purpose of scientific research and development. Moreover, it is necessary to ensure that this Regulation does not otherwise affect scientific research and development activity on Error! Post not found for word:ai systems or models prior to being placed on the market or put into service. As regards product-oriented research, testing and development activity regarding Error! Post not found for word:ai systems or models, the provisions of this Regulation should also not apply prior to those systems and models being put into service or placed on the market. That exclusion is without prejudice to the obligation to comply with this Regulation where an Error! Post not found for word:ai system falling into the scope of this Regulation is placed on the market or put into service as a result of such research and development activity and to the application of provisions on AI regulatory sandboxes and testing in real world conditions. Furthermore, without prejudice to the exclusion of Error! Post not found for word:ai systems specifically developed and put into service for the sole purpose of scientific research and development, any other Error! Post not found for word:ai system that may be used for the conduct of any research and development activity should remain Error! Post not found for word:subject to the provisions of this Regulation. In any event, any research and development activity should be carried out in accordance with recognised ethical and professional standards for scientific research and should be conducted in accordance with applicable Union law.
(26) In order to introduce a proportionate and effective set of binding rules for Error! Post not found for word:ai systems, a clearly defined Error! Post not found for word:risk-based approach should be followed. That approach should tailor the type and content of such rules to the intensity and scope of the risks that Error! Post not found for word:ai systems can generate. It is therefore necessary to prohibit certain unacceptable AI practices, to lay down requirements for high-Error! Post not found for word:risk Error! Post not found for word:ai systems and obligations for the relevant Error! Post not found for word:operators, and to lay down transparency obligations for certain Error! Post not found for word:ai systems.
(27) While the Error! Post not found for word:risk-based approach is the basis for a proportionate and effective set of binding rules, it is important to recall the 2019 Ethics guidelines for trustworthy AI developed by the independent AI HLEG appointed by the Commission. In those guidelines, the AI HLEG developed seven non-binding ethical principles for AI which are intended to help ensure that AI is trustworthy and ethically sound. The seven principles include human agency and oversight; technical robustness and safety; privacy and Error! Post not found for word:data governance; transparency; diversity, non-discrimination and fairness; societal and environmental well-being and Error! Post not found for word:accountability. Without prejudice to the legally binding requirements of this Regulation and any other applicable Union law, those guidelines contribute to the design of a coherent, trustworthy and human-centric AI, in line with the Charter and with the values on which the Union is founded. According to the guidelines of the AI HLEG, human agency and oversight means that Error! Post not found for word:ai systems are developed and used as a tool that serves people, respects human dignity and personal autonomy, and that is functioning in a way that can be appropriately controlled and overseen by humans.
Technical robustness and safety means that Error! Post not found for word:ai systems are developed and used in a way that allows robustness in the case of problems and resilience against attempts to alter the use or performance of the Error! Post not found for word:ai system so as to allow unlawful use by third parties, and minimise unintended harm. Privacy and Error! Post not found for word:data governance means that Error! Post not found for word:ai systems are developed and used in accordance with privacy and Error! Post not found for word:data protection rules, while Error! Post not found for word:processing Error! Post not found for word:data that meets high standards in terms of quality and integrity. Transparency means that Error! Post not found for word:ai systems are developed and used in a way that allows appropriate traceability and explainability, while making humans aware that they communicate or interact with an Error! Post not found for word:ai system, as well as duly informing Error! Post not found for word:deployers of the capabilities and limitations of that Error! Post not found for word:ai system and affected persons about their rights. Diversity, non-discrimination and fairness means that Error! Post not found for word:ai systems are developed and used in a way that includes diverse actors and promotes equal access, gender equality and cultural diversity, while avoiding discriminatory impacts and unfair biases that are prohibited by Union or national law. Social and environmental well-being means that Error! Post not found for word:ai systems are developed and used in a sustainable and environmentally friendly manner as well as in a way to benefit all human beings, while monitoring and assessing the long-term impacts on the individual, society and democracy. The application of those principles should be translated, when possible, in the design and use of AI models. They should in any case serve as a basis for the drafting of Error! Post not found for word:codes of conduct under this Regulation. All stakeholders, including industry, academia, civil society and standardisation organisations, are encouraged to take into account as appropriate the ethical principles for the development of voluntary best practices and standards.
(28) Aside from the many beneficial uses of AI, it can also be misused and provide novel and powerful tools for manipulative, exploitative and social control practices. Such practices are particularly harmful and abusive and should be prohibited because they contradict Union values of respect for human dignity, freedom, equality, democracy and the rule of law and fundamental rights enshrined in the Charter, including the right to non-discrimination, to Error! Post not found for word:data protection and to privacy and the rights of the child.
(29) AI-enabled manipulative techniques can be used to persuade persons to engage in unwanted behaviours, or to deceive them by nudging them into decisions in a way that subverts and impairs their autonomy, decision-making and free choices. The placing on the market, the putting into service or the use of certain Error! Post not found for word:ai systems with the objective to or the effect of materially distorting human behaviour, whereby significant harms, in particular having sufficiently important adverse impacts on physical, psychological health or financial interests are likely to occur, are particularly dangerous and should therefore be prohibited. Such Error! Post not found for word:ai systems deploy subliminal components such as audio, image, video stimuli that persons cannot perceive as those stimuli are beyond human perception or other manipulative or deceptive techniques that subvert or impair person’s autonomy, decision-making or free choice in ways that people are not consciously aware of these techniques or, where they are aware of them, can still be deceived or are not able to control or resist them. This could be facilitated, for example, by machine-brain interfaces or virtual reality as they allow for a higher degree of control of what stimuli are presented to persons, insofar as they may materially distort their behaviour in a significantly harmful manner. In addition, Error! Post not found for word:ai systems may also otherwise exploit the vulnerabilities of a person or a specific group of persons due to their age, disability within the meaning of Directive (EU) 2019/882 of the European Parliament and of the Council(19), or a specific social or economic situation that is likely to make those persons more vulnerable to exploitation such as persons living in extreme poverty, ethnic or religious minorities.
Such Error! Post not found for word:ai systems can be placed on the market, put into service or used with the objective to or the effect of materially distorting the behaviour of a person and in a manner that causes or is reasonably likely to cause significant harm to that or another person or groups of persons, including harms that may be accumulated over time and should therefore be prohibited. It may not be possible to assume that there is an intention to distort behaviour where the distortion results from factors external to the Error! Post not found for word:ai system which are outside the control of the Error! Post not found for word:provider or the Error! Post not found for word:deployer, namely factors that may not be reasonably foreseeable and therefore not possible for the Error! Post not found for word:provider or the Error! Post not found for word:deployer of the Error! Post not found for word:ai system to mitigate. In any case, it is not necessary for the Error! Post not found for word:provider or the Error! Post not found for word:deployer to have the intention to cause significant harm, provided that such harm results from the manipulative or exploitative AI-enabled practices. The prohibitions for such AI practices are complementary to the provisions contained in Directive 2005/29/EC of the European Parliament and of the Council(20), in particular unfair commercial practices leading to economic or financial harms to consumers are prohibited under all circumstances, irrespective of whether they are put in place through Error! Post not found for word:ai systems or otherwise. The prohibitions of manipulative and exploitative practices in this Regulation should not affect lawful practices in the context of medical treatment such as psychological treatment of a mental disease or physical rehabilitation, when those practices are carried out in accordance with the applicable law and medical standards, for example explicit Error! Post not found for word:consent of the individuals or their legal Error! Post not found for word:representatives. In addition, common and legitimate commercial practices, for example in the field of advertising, that comply with the applicable law should not, in themselves, be regarded as constituting harmful manipulative AI-enabled practices.
(30) Biometric categorisation systems that are based on natural persons’ Error! Post not found for word:biometric Error! Post not found for word:data, such as an individual person’s face or fingerprint, to deduce or infer an individuals’ political opinions, trade union membership, religious or philosophical beliefs, race, sex life or sexual orientation should be prohibited. That prohibition should not cover the lawful labelling, filtering or categorisation of Error! Post not found for word:biometric Error! Post not found for word:data sets acquired in line with Union or national law according to Error! Post not found for word:biometric Error! Post not found for word:data, such as the sorting of images according to hair colour or eye colour, which can for example be used in the area of Error! Post not found for word:law enforcement.
(31) Error! Post not found for word:ai systems providing social scoring of natural persons by public or private actors may lead to discriminatory outcomes and the exclusion of certain groups. They may violate the right to dignity and non-discrimination and the values of equality and justice. Such Error! Post not found for word:ai systems evaluate or classify natural persons or groups thereof on the basis of multiple Error! Post not found for word:data points related to their social behaviour in multiple contexts or known, inferred or predicted personal or personality characteristics over certain periods of time. The social score obtained from such Error! Post not found for word:ai systems may lead to the detrimental or unfavourable treatment of natural persons or whole groups thereof in social contexts, which are unrelated to the context in which the Error! Post not found for word:data was originally generated or collected or to a detrimental treatment that is disproportionate or unjustified to the gravity of their social behaviour. Error! Post not found for word:ai systems entailing such unacceptable scoring practices and leading to such detrimental or unfavourable outcomes should therefore be prohibited. That prohibition should not affect lawful evaluation practices of natural persons that are carried out for a specific purpose in accordance with Union and national law.
(32) The use of Error! Post not found for word:ai systems for ‘real-time’ remote biometric identification of natural persons in publicly accessible spaces for the purpose of Error! Post not found for word:law enforcement is particularly intrusive to the rights and freedoms of the concerned persons, to the extent that it may affect the private life of a large part of the population, evoke a feeling of constant surveillance and indirectly dissuade the exercise of the freedom of assembly and other fundamental rights. Technical inaccuracies of Error! Post not found for word:ai systems intended for the remote biometric identification of natural persons can lead to biased results and entail discriminatory effects. Such possible biased results and discriminatory effects are particularly relevant with regard to age, ethnicity, race, sex or disabilities. In addition, the immediacy of the impact and the limited opportunities for further checks or corrections in relation to the use of such systems operating in real-time carry heightened risks for the rights and freedoms of the persons concerned in the context of, or impacted by, Error! Post not found for word:law enforcement activities.
(33) The use of those systems for the purpose of Error! Post not found for word:law enforcement should therefore be prohibited, except in exhaustively listed and narrowly defined situations, where the use is strictly necessary to achieve a substantial public interest, the importance of which outweighs the risks. Those situations involve the search for certain victims of crime including missing persons; certain threats to the life or to the physical safety of natural persons or of a terrorist attack; and the localisation or identification of perpetrators or suspects of the criminal offences listed in an annex to this Regulation, where those criminal offences are punishable in the Member State concerned by a custodial sentence or a detention order for a maximum period of at least four years and as they are defined in the law of that Member State. Such a threshold for the custodial sentence or detention order in accordance with national law contributes to ensuring that the offence should be serious enough to potentially justify the use of ‘real-time’ remote biometric identification systems.
Moreover, the list of criminal offences provided in an annex to this Regulkation is based on the 32 criminal offences listed in the Council Framework Decision 2002/584/JHA(21), taking into account that some of those offences are, in practice, likely to be more relevant than others, in that the recourse to ‘real-time’ remote biometric identification could, foreseeably, be necessary and proportionate to highly varying degrees for the practical pursuit of the localisation or identification of a perpetrator or suspect of the different criminal offences listed and having regard to the likely differences in the seriousness, probability and scale of the harm or possible negative consequences. An imminent threat to life or the physical safety of natural persons could also result from a serious disruption of critical infrastructure, as defined in Article 2, point (4) of Directive (EU) 2022/2557 of the European Parliament and of the Council(22), where the disruption or destruction of such critical infrastructure would result in an imminent threat to life or the physical safety of a person, including through serious harm to the provision of basic supplies to the population or to the exercise of the core function of the State. In addition, this Regulation should preserve the ability for Error! Post not found for word:law enforcement, border control, immigration or asylum authorities to carry out identity checks in the presence of the person concerned in accordance with the conditions set out in Union and national law for such checks. In particular, Error! Post not found for word:law enforcement, border control, immigration or asylum authorities should be able to use information systems, in accordance with Union or national law, to identify persons who, during an identity check, either refuse to be identified or are unable to state or prove their identity, without being required by this Regulation to obtain prior authorisation. This could be, for example, a person involved in a crime, being unwilling, or unable due to an accident or a medical condition, to disclose their identity to Error! Post not found for word:law enforcement authorities.
(34) In order to ensure that those systems are used in a responsible and proportionate manner, it is also important to establish that, in each of those exhaustively listed and narrowly defined situations, certain elements should be taken into account, in particular as regards the nature of the situation giving rise to the request and the consequences of the use for the rights and freedoms of all persons concerned and the safeguards and conditions provided for with the use. In addition, the use of ‘real-time’ remote biometric identification systems in publicly accessible spaces for the purpose of Error! Post not found for word:law enforcement should be deployed only to confirm the specifically targeted individual’s identity and should be limited to what is strictly necessary concerning the period of time as well as the geographic and personal scope, having regard in particular to the evidence or indications regarding the threats, the victims or perpetrator. The use of the real-time remote biometric identification system in publicly accessible spaces should be authorised only if the relevant law enforcement authority has completed a fundamental rights impact assessment and, unless provided otherwise in this Regulation, has registered the system in the database as set out in this Regulation. The reference database of persons should be appropriate for each use case in each of the situations mentioned above.
(35) Each use of a ‘real-time’ remote biometric identification system in publicly accessible spaces for the purpose of Error! Post not found for word:law enforcement should be Error! Post not found for word:subject to an express and specific authorisation by a judicial authority or by an independent administrative authority of a Member State whose decision is binding. Such authorisation should, in principle, be obtained prior to the use of the Error! Post not found for word:ai system with a view to identifying a person or persons. Exceptions to that rule should be allowed in duly justified situations on grounds of urgency, namely, in situations where the need to use the systems concerned is such as to make it effectively and objectively impossible to obtain an authorisation before commencing the use of the Error! Post not found for word:ai system. In such situations of urgency, the use of the Error! Post not found for word:ai system should be restricted to the absolute minimum necessary and should be Error! Post not found for word:subject to appropriate safeguards and conditions, as determined in national law and specified in the context of each individual urgent use case by the law enforcement authority itself. In addition, the law enforcement authority should in such situations request such authorisation while providing the reasons for not having been able to request it earlier, without undue delay and, at the latest within 24 hours. If such an authorisation is rejected, the use of real-time biometric identification systems linked to that authorisation should cease with immediate effect and all the Error! Post not found for word:data related to such use should be discarded and deleted. Such Error! Post not found for word:data includes Error! Post not found for word:input data directly acquired by an Error! Post not found for word:ai system in the course of the use of such system as well as the results and outputs of the use linked to that authorisation. It should not include input that is legally acquired in accordance with another Union or national law. In any case, no decision producing an adverse legal effect on a person should be taken based solely on the output of the remote biometric identification system.
(36) In order to carry out their tasks in accordance with the requirements set out in this Regulation as well as in national rules, the relevant market surveillance authority and the national Error! Post not found for word:data protection authority should be notified of each use of the real-time biometric identification system. Market surveillance authorities and the national Error! Post not found for word:data protection authorities that have been notified should submit to the Commission an annual report on the use of real-time biometric identification systems.
(37) Furthermore, it is appropriate to provide, within the exhaustive framework set by this Regulation that such use in the territory of a Member State in accordance with this Regulation should only be possible where and in as far as the Member State concerned has decided to expressly provide for the possibility to authorise such use in its detailed rules of national law. Consequently, Member States remain free under this Regulation not to provide for such a possibility at all or to only provide for such a possibility in respect of some of the objectives capable of justifying authorised use identified in this Regulation. Such national rules should be notified to the Commission within 30 days of their adoption.
(38) The use of Error! Post not found for word:ai systems for real-time remote biometric identification of natural persons in publicly accessible spaces for the purpose of Error! Post not found for word:law enforcement necessarily involves the Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data. The rules of this Regulation that prohibit, Error! Post not found for word:subject to certain exceptions, such use, which are based on Article 16 TFEU, should apply as lex specialis in respect of the rules on the Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data contained in Article 10 of Directive (EU) 2016/680, thus regulating such use and the Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data involved in an exhaustive manner. Therefore, such use and Error! Post not found for word:processing should be possible only in as far as it is compatible with the framework set by this Regulation, without there being scope, outside that framework, for the competent authorities, where they act for purpose of Error! Post not found for word:law enforcement, to use such systems and process such Error! Post not found for word:data in connection thereto on the grounds listed in Article 10 of Directive (EU) 2016/680. In that context, this Regulation is not intended to provide the legal basis for the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data under Article 8 of Directive (EU) 2016/680. However, the use of real-time remote biometric identification systems in publicly accessible spaces for purposes other than Error! Post not found for word:law enforcement, including by competent authorities, should not be covered by the specific framework regarding such use for the purpose of Error! Post not found for word:law enforcement set by this Regulation. Such use for purposes other than Error! Post not found for word:law enforcement should therefore not be Error! Post not found for word:subject to the requirement of an authorisation under this Regulation and the applicable detailed rules of national law that may give effect to that authorisation.
(39) Any Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data and other Error! Post not found for word:personal Error! Post not found for word:data involved in the use of Error! Post not found for word:ai systems for biometric identification, other than in connection to the use of real-time remote biometric identification systems in publicly accessible spaces for the purpose of Error! Post not found for word:law enforcement as regulated by this Regulation, should continue to comply with all requirements resulting from Article 10 of Directive (EU) 2016/680. For purposes other than Error! Post not found for word:law enforcement, Article 9(1) of Regulation (EU) 2016/679 and Article 10(1) of Regulation (EU) 2018/1725 prohibit the Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data Error! Post not found for word:subject to limited exceptions as provided in those Articles. In the application of Article 9(1) of Regulation (EU) 2016/679, the use of remote biometric identification for purposes other than Error! Post not found for word:law enforcement has already been Error! Post not found for word:subject to prohibition decisions by national Error! Post not found for word:data protection authorities.
(40) In accordance with Article 6a of Protocol No 21 on the position of the United Kingdom and Ireland in respect of the area of freedom, security and justice, as annexed to the TEU and to the TFEU, Ireland is not bound by the rules laid down in Article 5(1), first subparagraph, point (g) to the extent it applies to the use of biometric categorisation systems for activities in the field of police cooperation and judicial cooperation in criminal matters, Article 5(1), first subparagraph, point (d) to the extent it applies to the use of Error! Post not found for word:ai systems covered by that provision, Article 5(1) , first subparagraph, point (h), Article 5(2) to (6) and Article 26(10) of this Regulation adopted on the basis of Article 16 TFEU which relate to the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data by the Member States when carrying out activities falling within the scope of Chapter 4 or Chapter 5 of Title V of Part Three of the TFEU, where Ireland is not bound by the rules governing the forms of judicial cooperation in criminal matters or police cooperation which require compliance with the provisions laid down on the basis of Article 16 TFEU.
(41) In accordance with Articles 2 and 2a of Protocol No 22 on the position of Denmark, annexed to the TEU and to the TFEU, Denmark is not bound by rules laid down in Article 5(1), first subparagraph, point (g) to the extent it applies to the use of biometric categorisation systems for activities in the field of police cooperation and judicial cooperation in criminal matters, Article 5(1), first subparagraph, point (d), to the extent it applies to the use of Error! Post not found for word:ai systems covered by that provision, Article 5(1), first subparagraph, point (h), (2) to (6) and Article 26(10) of this Regulation adopted on the basis of Article 16 TFEU, or Error! Post not found for word:subject to their application, which relate to the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data by the Member States when carrying out activities falling within the scope of Chapter 4 or Chapter 5 of Title V of Part Three of the TFEU.
(42) In line with the presumption of innocence, natural persons in the Union should always be judged on their actual behaviour. Natural persons should never be judged on AI-predicted behaviour based solely on their Error! Post not found for word:profiling, personality traits or characteristics, such as nationality, place of birth, place of residence, number of children, level of debt or type of car, without a reasonable suspicion of that person being involved in a criminal activity based on objective verifiable facts and without human assessment thereof. Therefore, Error! Post not found for word:risk assessments carried out with regard to natural persons in order to assess the likelihood of their offending or to predict the occurrence of an actual or potential criminal offence based solely on Error! Post not found for word:profiling them or on assessing their personality traits and characteristics should be prohibited. In any case, that prohibition does not refer to or touch upon Error! Post not found for word:risk analytics that are not based on the Error! Post not found for word:profiling of individuals or on the personality traits and characteristics of individuals, such as Error! Post not found for word:ai systems using Error! Post not found for word:risk analytics to assess the likelihood of financial fraud by Error! Post not found for word:undertakings on the basis of suspicious transactions or Error! Post not found for word:risk analytic tools to predict the likelihood of the localisation of narcotics or illicit goods by customs authorities, for example on the basis of known trafficking routes.
(43) The placing on the market, the putting into service for that specific purpose, or the use of Error! Post not found for word:ai systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage, should be prohibited because that practice adds to the feeling of mass surveillance and can lead to gross violations of fundamental rights, including the right to privacy.
(44) There are serious concerns about the scientific basis of Error! Post not found for word:ai systems aiming to identify or infer emotions, particularly as expression of emotions vary considerably across cultures and situations, and even within a single individual. Among the key shortcomings of such systems are the limited reliability, the lack of specificity and the limited generalisability. Therefore, Error! Post not found for word:ai systems identifying or inferring emotions or intentions of natural persons on the basis of their Error! Post not found for word:biometric Error! Post not found for word:data may lead to discriminatory outcomes and can be intrusive to the rights and freedoms of the concerned persons. Considering the imbalance of power in the context of work or education, combined with the intrusive nature of these systems, such systems could lead to detrimental or unfavourable treatment of certain natural persons or whole groups thereof. Therefore, the placing on the market, the putting into service, or the use of Error! Post not found for word:ai systems intended to be used to detect the emotional state of individuals in situations related to the workplace and education should be prohibited. That prohibition should not cover Error! Post not found for word:ai systems placed on the market strictly for medical or safety reasons, such as systems intended for therapeutical use.
(45) Practices that are prohibited by Union law, including Error! Post not found for word:data protection law, non-discrimination law, Error! Post not found for word:consumer protection law, and competition law, should not be affected by this Regulation.
(46) High-Error! Post not found for word:risk Error! Post not found for word:ai systems should only be placed on the Union market, put into service or used if they comply with certain mandatory requirements. Those requirements should ensure that high-Error! Post not found for word:risk Error! Post not found for word:ai systems available in the Union or whose output is otherwise used in the Union do not pose unacceptable risks to important Union public interests as recognised and protected by Union law. On the basis of the New Legislative Framework, as clarified in the Commission notice ‘The “Blue Guide” on the implementation of EU product rules 2022′(23), the general rule is that more than one legal act Union harmonisation legislation, such as Regulations (EU) 2017/745(24) and (EU) 2017/746(25) of the European Parliament and of the Council or Directive 2006/42/EC of the European Parliament and of the Council(26), may be applicable to one product, since the making available or putting into service can take place only when the product complies with all applicable Union harmonisation legislation. To ensure consistency and avoid unnecessary administrative burdens or costs, Error! Post not found for word:providers of a product that contains one or more high-Error! Post not found for word:risk Error! Post not found for word:ai systems, to which the requirements of this Regulation and of the Union harmonisation legislation listed in an annex to this Regulation apply, should have flexibility with regard to operational decisions on how to ensure compliance of a product that contains one or more Error! Post not found for word:ai systems with all applicable requirements of the Union harmonisation legislation in an optimal manner. Error! Post not found for word:ai systems identified as high-Error! Post not found for word:risk should be limited to those that have a significant harmful impact on the health, safety and fundamental rights of persons in the Union and such limitation should minimise any potential restriction to international trade.
(47) Error! Post not found for word:ai systems could have an adverse impact on the health and safety of persons, in particular when such systems operate as safety components of products. Consistent with the objectives of Union harmonisation legislation to facilitate the free movement of products in the internal market and to ensure that only safe and otherwise compliant products find their way into the market, it is important that the safety risks that may be generated by a product as a whole due to its digital components, including Error! Post not found for word:ai systems, are duly prevented and mitigated. For instance, increasingly autonomous robots, whether in the context of manufacturing or personal assistance and care should be able to safely operate and performs their functions in complex environments. Similarly, in the health sector where the stakes for life and health are particularly high, increasingly sophisticated diagnostics systems and systems supporting human decisions should be reliable and accurate.
(48) The extent of the adverse impact caused by the Error! Post not found for word:ai system on the fundamental rights protected by the Charter is of particular relevance when classifying an Error! Post not found for word:ai system as high Error! Post not found for word:risk. Those rights include the right to human dignity, respect for private and family life, protection of Error! Post not found for word:personal Error! Post not found for word:data, freedom of expression and information, freedom of assembly and of association, the right to non-discrimination, the right to education Error! Post not found for word:consumer protection, workers’ rights, the rights of persons with disabilities, gender equality, intellectual property rights, the right to an effective remedy and to a fair trial, the right of defence and the presumption of innocence, the right to good administration. In addition to those rights, it is important to highlight the fact that children have specific rights as enshrined in Article 24 of the Charter and in the United Nations Convention on the Rights of the Child, further developed in the UNCRC General Comment No 25 as regards the digital environment, both of which require consideration of the children’s vulnerabilities and provision of such protection and care as necessary for their well-being. The fundamental right to a high level of environmental protection enshrined in the Charter and implemented in Union policies should also be considered when assessing the severity of the harm that an Error! Post not found for word:ai system can cause, including in relation to the health and safety of persons.
(49) As regards high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are safety components of products or systems, or which are themselves products or systems falling within the scope of Regulation (EC) No 300/2008 of the European Parliament and of the Council(27), Regulation (EU) No 167/2013 of the European Parliament and of the Council(28), Regulation (EU) No 168/2013 of the European Parliament and of the Council(29), Directive 2014/90/EU of the European Parliament and of the Council(30), Directive (EU) 2016/797 of the European Parliament and of the Council(31), Regulation (EU) 2018/858 of the European Parliament and of the Council(32),
Regulation (EU) 2018/1139 of the European Parliament and of the Council(33), and Regulation (EU) 2019/2144 of the European Parliament and of the Council(34), it is appropriate to amend those acts to ensure that the Commission takes into account, on the basis of the technical and regulatory specificities of each sector, and without interfering with existing governance, conformity assessment and enforcement mechanisms and authorities established therein, the mandatory requirements for high-Error! Post not found for word:risk Error! Post not found for word:ai systems laid down in this Regulation when adopting any relevant delegated or implementing acts on the basis of those acts.
(50) As regards Error! Post not found for word:ai systems that are safety components of products, or which are themselves products, falling within the scope of certain Union harmonisation legislation listed in an annex to this Regulation, it is appropriate to classify them as high-Error! Post not found for word:risk under this Regulation if the product concerned undergoes the conformity assessment procedure with a third-party conformity assessment body pursuant to that relevant Union harmonisation legislation. In particular, such products are machinery, toys, lifts, equipment and protective systems intended for use in potentially explosive atmospheres, radio equipment, pressure equipment, recreational craft equipment, cableway installations, appliances burning gaseous fuels, medical devices, in vitro diagnostic medical devices, automotive and aviation.
(51) The classification of an Error! Post not found for word:ai system as high-Error! Post not found for word:risk pursuant to this Regulation should not necessarily mean that the product whose safety Error! Post not found for word:component is the Error! Post not found for word:ai system, or the Error! Post not found for word:ai system itself as a product, is considered to be high-Error! Post not found for word:risk under the criteria established in the relevant Union harmonisation legislation that applies to the product. This is, in particular, the case for Regulations (EU) 2017/745 and (EU) 2017/746, where a third-party conformity assessment is provided for medium-Error! Post not found for word:risk and high-Error! Post not found for word:risk products.
(52) As regards stand-alone Error! Post not found for word:ai systems, namely high-Error! Post not found for word:risk Error! Post not found for word:ai systems other than those that are safety components of products, or that are themselves products, it is appropriate to classify them as high-Error! Post not found for word:risk if, in light of their Error! Post not found for word:intended purpose, they pose a high Error! Post not found for word:risk of harm to the health and safety or the fundamental rights of persons, taking into account both the severity of the possible harm and its probability of occurrence and they are used in a number of specifically pre-defined areas specified in this Regulation. The identification of those systems is based on the same methodology and criteria envisaged also for any future amendments of the list of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that the Commission should be empowered to adopt, via delegated acts, to take into account the rapid pace of technological development, as well as the potential changes in the use of Error! Post not found for word:ai systems.
(53) It is also important to clarify that there may be specific cases in which Error! Post not found for word:ai systems referred to in pre-defined areas specified in this Regulation do not lead to a significant Error! Post not found for word:risk of harm to the legal interests protected under those areas because they do not materially influence the decision-making or do not harm those interests substantially. For the purposes of this Regulation an Error! Post not found for word:ai system that does not materially influence the outcome of decision-making should be understood to be an Error! Post not found for word:ai system that does not have an impact on the substance, and thereby the outcome, of decision-making, whether human or automated. An Error! Post not found for word:ai system that does not materially influence the outcome of decision-making could include situations in which one or more of the following conditions are fulfilled. The first such condition should be that the Error! Post not found for word:ai system is intended to perform a narrow procedural task, such as an Error! Post not found for word:ai system that transforms unstructured Error! Post not found for word:data into structured Error! Post not found for word:data, an Error! Post not found for word:ai system that classifies incoming documents into categories or an Error! Post not found for word:ai system that is used to detect duplicates among a large number of applications. Those tasks are of such narrow and limited nature that they pose only limited risks which are not increased through the use of an Error! Post not found for word:ai system in a context that is listed as a high-Error! Post not found for word:risk use in an annex to this Regulation. The second condition should be that the task performed by the Error! Post not found for word:ai system is intended to improve the result of a previously completed human activity that may be relevant for the purposes of the high-Error! Post not found for word:risk uses listed in an annex to this Regulation. Considering those characteristics, the Error! Post not found for word:ai system provides only an additional layer to a human activity with consequently lowered Error! Post not found for word:risk. That condition would, for example, apply to Error! Post not found for word:ai systems that are intended to improve the language used in previously drafted documents, for example in relation to professional tone, academic style of language or by aligning text to a certain brand messaging.
The third condition should be that the Error! Post not found for word:ai system is intended to detect decision-making patterns or deviations from prior decision-making patterns. The Error! Post not found for word:risk would be lowered because the use of the Error! Post not found for word:ai system follows a previously completed human assessment which it is not meant to replace or influence, without proper human review. Such Error! Post not found for word:ai systems include for instance those that, given a certain grading pattern of a teacher, can be used to check ex post whether the teacher may have deviated from the grading pattern so as to flag potential inconsistencies or anomalies. The fourth condition should be that the Error! Post not found for word:ai system is intended to perform a task that is only preparatory to an assessment relevant for the purposes of the Error! Post not found for word:ai systems listed in an annex to this Regulation, thus making the possible impact of the output of the system very low in terms of representing a Error! Post not found for word:risk for the assessment to follow. That condition covers, inter alia, smart solutions for file handling, which include various functions from indexing, searching, text and speech Error! Post not found for word:processing or linking Error! Post not found for word:data to other Error! Post not found for word:data sources, or Error! Post not found for word:ai systems used for translation of initial documents. In any case, Error! Post not found for word:ai systems used in high-Error! Post not found for word:risk use-cases listed in an annex to this Regulation should be considered to pose significant risks of harm to the health, safety or fundamental rights if the Error! Post not found for word:ai system implies Error! Post not found for word:profiling within the meaning of Article 4, point (4) of Regulation (EU) 2016/679 or Article 3, point (4) of Directive (EU) 2016/680 or Article 3, point (5) of Regulation (EU) 2018/1725. To ensure traceability and transparency, a Error! Post not found for word:provider who considers that an Error! Post not found for word:ai system is not high-Error! Post not found for word:risk on the basis of the conditions referred to above should draw up documentation of the assessment before that system is placed on the market or put into service and should provide that documentation to national competent authorities upon request. Such a Error! Post not found for word:provider should be obliged to register the Error! Post not found for word:ai system in the EU database established under this Regulation. With a view to providing further guidance for the practical implementation of the conditions under which the Error! Post not found for word:ai systems listed in an annex to this Regulation are, on an exceptional basis, non-high-Error! Post not found for word:risk, the Commission should, after consulting the Board, provide guidelines specifying that practical implementation completed by a comprehensive list of practical examples of use cases of Error! Post not found for word:ai systems that are high-Error! Post not found for word:risk and use-vases that are not.
(54) As Error! Post not found for word:biometric Error! Post not found for word:data constitutes a special category of personal data, it is appropriate to classify as high-Error! Post not found for word:risk several critical-use cases of biometric systems, insofar as their use is permitted under relevant Union and national law. Technical inaccuracies of Error! Post not found for word:ai systems intended for the remote biometric identification of natural persons can lead to biased results and entail discriminatory effects. The Error! Post not found for word:risk of such biased results and discriminatory effects is particularly relevant with regard to age, ethnicity, race, sex or disabilities. Remote biometric identification systems should therefore be classified as high-Error! Post not found for word:risk in view of the risks that they pose. Such a classification excludes Error! Post not found for word:ai systems intended to be used for biometric verification, including authentication, the sole purpose of which is to confirm that a specific natural person is who that person claims to be and to confirm the identity of a natural person for the sole purpose of having access to a service, unlocking a device or having secure access to premises. In addition, Error! Post not found for word:ai systems intended to be used for biometric categorisation according to sensitive attributes or characteristics protected under Article 9(1) of Regulation (EU) 2016/679 on the basis of Error! Post not found for word:biometric Error! Post not found for word:data, in so far as these are not prohibited under this Regulation, and emotion recognition systems that are not prohibited under this Regulation, should be classified as high-Error! Post not found for word:risk. Biometric systems which are intended to be used solely for the purpose of enabling Error! Post not found for word:cybersecurity and Error! Post not found for word:personal Error! Post not found for word:data protection measures should not be considered to be high-Error! Post not found for word:risk Error! Post not found for word:ai systems.
(55) As regards the management and operation of critical infrastructure, it is appropriate to classify as high-Error! Post not found for word:risk the Error! Post not found for word:ai systems intended to be used as safety components in the management and operation of critical digital infrastructure as listed in point (8) of the Annex to Directive (EU) 2022/2557, road traffic and the supply of water, gas, heating and electricity, since their failure or malfunctioning may put at Error! Post not found for word:risk the life and health of persons at large scale and lead to appreciable disruptions in the ordinary conduct of social and economic activities. Safety components of critical infrastructure, including critical digital infrastructure, are systems used to directly protect the physical integrity of critical infrastructure or the health and safety of persons and property but which are not necessary in order for the system to function. The failure or malfunctioning of such components might directly lead to risks to the physical integrity of critical infrastructure and thus to risks to health and safety of persons and property. Components intended to be used solely for Error! Post not found for word:cybersecurity purposes should not qualify as safety components. Examples of safety components of such critical infrastructure may include systems for monitoring water pressure or fire alarm controlling systems in cloud computing centres.
(56) The deployment of Error! Post not found for word:ai systems in education is important to promote high-quality digital education and training and to allow all learners and teachers to acquire and share the necessary digital skills and competences, including media literacy, and critical thinking, to take an active part in the economy, society, and in democratic processes. However, Error! Post not found for word:ai systems used in education or vocational training, in particular for determining access or admission, for assigning persons to educational and vocational training institutions or programmes at all levels, for evaluating learning outcomes of persons, for assessing the appropriate level of education for an individual and materially influencing the level of education and training that individuals will receive or will be able to access or for monitoring and detecting prohibited behaviour of students during tests should be classified as high-Error! Post not found for word:risk Error! Post not found for word:ai systems, since they may determine the educational and professional course of a person’s life and therefore may affect that person’s ability to secure a livelihood. When improperly designed and used, such systems may be particularly intrusive and may violate the right to education and training as well as the right not to be discriminated against and perpetuate historical patterns of discrimination, for example against women, certain age groups, persons with disabilities, or persons of certain racial or ethnic origins or sexual orientation.
(57) Error! Post not found for word:ai systems used in employment, workers management and access to self-employment, in particular for the recruitment and selection of persons, for making decisions affecting terms of the work-related relationship promotion and termination of work-related contractual relationships for allocating tasks on the basis of individual behaviour, personal traits or characteristics and for monitoring or evaluation of persons in work-related contractual relationships, should also be classified as high-Error! Post not found for word:risk, since those systems may have an appreciable impact on future career prospects, livelihoods of those persons and workers’ rights. Relevant work-related contractual relationships should, in a meaningful manner, involve employees and persons providing services through platforms as referred to in the Commission Work Programme 2021. Throughout the recruitment process and in the evaluation, promotion, or retention of persons in work-related contractual relationships, such systems may perpetuate historical patterns of discrimination, for example against women, certain age groups, persons with disabilities, or persons of certain racial or ethnic origins or sexual orientation. Error! Post not found for word:ai systems used to monitor the performance and behaviour of such persons may also undermine their fundamental rights to Error! Post not found for word:data protection and privacy.
(58) Another area in which the use of Error! Post not found for word:ai systems deserves special consideration is the access to and enjoyment of certain essential private and public services and benefits necessary for people to fully participate in society or to improve one’s Error! Post not found for word:standard of living. In particular, natural persons applying for or receiving essential public assistance benefits and services from public authorities namely healthcare services, social security benefits, social services providing protection in cases such as maternity, illness, industrial accidents, dependency or old age and loss of employment and social and housing assistance, are typically dependent on those benefits and services and in a vulnerable position in relation to the responsible authorities. If Error! Post not found for word:ai systems are used for determining whether such benefits and services should be granted, denied, reduced, revoked or reclaimed by authorities, including whether beneficiaries are legitimately entitled to such benefits or services, those systems may have a significant impact on persons’ livelihood and may infringe their fundamental rights, such as the right to social protection, non-discrimination, human dignity or an effective remedy and should therefore be classified as high-Error! Post not found for word:risk. Nonetheless, this Regulation should not hamper the development and use of innovative approaches in the public administration, which would stand to benefit from a wider use of compliant and safe Error! Post not found for word:ai systems, provided that those systems do not entail a high Error! Post not found for word:risk to legal and natural persons.
In addition, Error! Post not found for word:ai systems used to evaluate the credit score or creditworthiness of natural persons should be classified as high-Error! Post not found for word:risk Error! Post not found for word:ai systems, since they determine those persons’ access to financial resources or essential services such as housing, electricity, and telecommunication services. Error! Post not found for word:ai systems used for those purposes may lead to discrimination between persons or groups and may perpetuate historical patterns of discrimination, such as that based on racial or ethnic origins, gender, disabilities, age or sexual orientation, or may create new forms of discriminatory impacts. However, Error! Post not found for word:ai systems provided for by Union law for the purpose of detecting fraud in the offering of financial services and for prudential purposes to calculate credit institutions’ and insurance Error! Post not found for word:undertakings’ capital requirements should not be considered to be high-Error! Post not found for word:risk under this Regulation. Moreover, Error! Post not found for word:ai systems intended to be used for Error! Post not found for word:risk assessment and pricing in relation to natural persons for health and life insurance can also have a significant impact on persons’ livelihood and if not duly designed, developed and used, can infringe their fundamental rights and can lead to serious consequences for people’s life and health, including financial exclusion and discrimination. Finally, Error! Post not found for word:ai systems used to evaluate and classify emergency calls by natural persons or to dispatch or establish priority in the dispatching of emergency first response services, including by police, firefighters and medical aid, as well as of emergency healthcare patient triage systems, should also be classified as high-Error! Post not found for word:risk since they make decisions in very critical situations for the life and health of persons and their property.
(59) Given their role and responsibility, actions by Error! Post not found for word:law enforcement authorities involving certain uses of Error! Post not found for word:ai systems are characterised by a significant degree of power imbalance and may lead to surveillance, arrest or deprivation of a natural person’s liberty as well as other adverse impacts on fundamental rights guaranteed in the Charter. In particular, if the Error! Post not found for word:ai system is not trained with high-quality Error! Post not found for word:data, does not meet adequate requirements in terms of its performance, its Error! Post not found for word:accuracy or robustness, or is not properly designed and tested before being put on the market or otherwise put into service, it may single out people in a discriminatory or otherwise incorrect or unjust manner. Furthermore, the exercise of important procedural fundamental rights, such as the right to an effective remedy and to a fair trial as well as the right of defence and the presumption of innocence, could be hampered, in particular, where such Error! Post not found for word:ai systems are not sufficiently transparent, explainable and documented. It is therefore appropriate to classify as high-Error! Post not found for word:risk, insofar as their use is permitted under relevant Union and national law, a number of Error! Post not found for word:ai systems intended to be used in the Error! Post not found for word:law enforcement context where Error! Post not found for word:accuracy, reliability and transparency is particularly important to avoid adverse impacts, retain public trust and ensure Error! Post not found for word:accountability and effective redress.
In view of the nature of the activities and the risks relating thereto, those high-Error! Post not found for word:risk Error! Post not found for word:ai systems should include in particular Error! Post not found for word:ai systems intended to be used by or on behalf of Error! Post not found for word:law enforcement authorities or by Union bodies, offices, or agencies in support of Error! Post not found for word:law enforcement authorities for assessing the Error! Post not found for word:risk of a natural person to become a victim of criminal offences, as polygraphs and similar tools, for the evaluation of the reliability of evidence in in the course of investigation or prosecution of criminal offences, and, insofar as not prohibited under this Regulation, for assessing the Error! Post not found for word:risk of a natural person offending or reoffending not solely on the basis of the Error! Post not found for word:profiling of natural persons or the assessment of personality traits and characteristics or the past criminal behaviour of natural persons or groups, for Error! Post not found for word:profiling in the course of detection, investigation or prosecution of criminal offences. Error! Post not found for word:ai systems specifically intended to be used for administrative proceedings by tax and customs authorities as well as by financial intelligence units carrying out administrative tasks analysing information pursuant to Union anti-money laundering law should not be classified as high-Error! Post not found for word:risk Error! Post not found for word:ai systems used by Error! Post not found for word:law enforcement authorities for the purpose of prevention, detection, investigation and prosecution of criminal offences. The use of AI tools by Error! Post not found for word:law enforcement and other relevant authorities should not become a factor of inequality, or exclusion. The impact of the use of AI tools on the defence rights of suspects should not be ignored, in particular the difficulty in obtaining meaningful information on the functioning of those systems and the resulting difficulty in challenging their results in court, in particular by natural persons under investigation.
(60) Error! Post not found for word:ai systems used in migration, asylum and border control management affect persons who are often in particularly vulnerable position and who are dependent on the outcome of the actions of the competent public authorities. The Error! Post not found for word:accuracy, non-discriminatory nature and transparency of the Error! Post not found for word:ai systems used in those contexts are therefore particularly important to guarantee respect for the fundamental rights of the affected persons, in particular their rights to free movement, non-discrimination, protection of private life and Error! Post not found for word:personal Error! Post not found for word:data, international protection and good administration. It is therefore appropriate to classify as high-Error! Post not found for word:risk, insofar as their use is permitted under relevant Union and national law Error! Post not found for word:ai systems intended to be used by or on behalf of competent public authorities or by Union institutions, bodies, offices or agencies charged with tasks in the fields of migration, asylum and border control management as polygraphs and similar tools, for assessing certain risks posed by natural persons entering the territory of a Member State or applying for visa or asylum, for assisting competent public authorities for the examination, including related assessment of the reliability of evidence, of applications for asylum, visa and residence permits and associated complaints with regard to the objective to establish the eligibility of the natural persons applying for a status, for the purpose of detecting, recognising or identifying natural persons in the context of migration, asylum and border control management with the exception of verification of travel documents.
Error! Post not found for word:ai systems in the area of migration, asylum and border control management covered by this Regulation should comply with the relevant procedural requirements set by the Regulation (EC) No 810/2009 of the European Parliament and of the Council(35), the Directive 2013/32/EU of the European Parliament and of the Council(36), and other relevant Union law. The use of Error! Post not found for word:ai systems in migration, asylum and border control management should, in no circumstances, be used by Member States or Union institutions, bodies, offices or agencies as a means to circumvent their international obligations under the UN Convention relating to the Status of Refugees done at Geneva on 28 July 1951 as amended by the Protocol of 31 January 1967. Nor should they be used to in any way infringe on the principle of non-refoulement, or to deny safe and effective legal avenues into the territory of the Union, including the right to international protection.
(61) Certain Error! Post not found for word:ai systems intended for the administration of justice and democratic processes should be classified as high-Error! Post not found for word:risk, considering their potentially significant impact on democracy, the rule of law, individual freedoms as well as the right to an effective remedy and to a fair trial. In particular, to address the risks of potential biases, errors and opacity, it is appropriate to qualify as high-Error! Post not found for word:risk Error! Post not found for word:ai systems intended to be used by a judicial authority or on its behalf to assist judicial authorities in researching and interpreting facts and the law and in applying the law to a concrete set of facts. Error! Post not found for word:ai systems intended to be used by alternative dispute resolution bodies for those purposes should also be considered to be high-Error! Post not found for word:risk when the outcomes of the alternative dispute resolution proceedings produce legal effects for the parties. The use of AI tools can support the decision-making power of judges or judicial independence, but should not replace it: the final decision-making must remain a human-driven activity. The classification of Error! Post not found for word:ai systems as high-Error! Post not found for word:risk should not, however, extend to Error! Post not found for word:ai systems intended for purely ancillary administrative activities that do not affect the actual administration of justice in individual cases, such as anonymisation or Error! Post not found for word:pseudonymisation of judicial decisions, documents or Error! Post not found for word:data, communication between personnel, administrative tasks.
(62) Without prejudice to the rules provided for in Regulation (EU) 2024/900 of the European Parliament and of the Council(37)(38), and in order to address the risks of undue external interference with the right to vote enshrined in Article 39 of the Charter, and of adverse effects on democracy and the rule of law, Error! Post not found for word:ai systems intended to be used to influence the outcome of an election or referendum or the voting behaviour of natural persons in the exercise of their vote in elections or referenda should be classified as high-Error! Post not found for word:risk Error! Post not found for word:ai systems with the exception of Error! Post not found for word:ai systems whose output natural persons are not directly exposed to, such as tools used to organise, optimise and structure political campaigns from an administrative and logistical point of view.
(63) The fact that an Error! Post not found for word:ai system is classified as a high-Error! Post not found for word:risk Error! Post not found for word:ai system under this Regulation should not be interpreted as indicating that the use of the system is lawful under other acts of Union law or under national law compatible with Union law, such as on the protection of Error! Post not found for word:personal Error! Post not found for word:data, on the use of polygraphs and similar tools or other systems to detect the emotional state of natural persons. Any such use should continue to occur solely in accordance with the applicable requirements resulting from the Charter and from the applicable acts of secondary Union law and national law. This Regulation should not be understood as providing for the legal ground for Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data, including special categories of personal data, where relevant, unless it is specifically otherwise provided for in this Regulation.
(64) To mitigate the risks from high-Error! Post not found for word:risk Error! Post not found for word:ai systems placed on the market or put into service and to ensure a high level of trustworthiness, certain mandatory requirements should apply to high-Error! Post not found for word:risk Error! Post not found for word:ai systems, taking into account the Error! Post not found for word:intended purpose and the context of use of the Error! Post not found for word:ai system and according to the Error! Post not found for word:risk-management system to be established by the Error! Post not found for word:provider. The measures adopted by the Error! Post not found for word:providers to comply with the mandatory requirements of this Regulation should take into account the generally acknowledged state of the art on AI, be proportionate and effective to meet the objectives of this Regulation. Based on the New Legislative Framework, as clarified in Commission notice ‘The “Blue Guide” on the implementation of EU product rules 2022’, the general rule is that more than one legal act of Union harmonisation legislation may be applicable to one product, since the making available or putting into service can take place only when the product complies with all applicable Union harmonisation legislation. The hazards of Error! Post not found for word:ai systems covered by the requirements of this Regulation concern different aspects than the existing Union harmonisation legislation and therefore the requirements of this Regulation would complement the existing body of the Union harmonisation legislation. For example, machinery or medical devices products incorporating an Error! Post not found for word:ai system might present risks not addressed by the essential health and safety requirements set out in the relevant Union harmonised legislation, as that sectoral law does not deal with risks specific to Error! Post not found for word:ai systems.
This calls for a simultaneous and complementary application of the various legislative acts. To ensure consistency and to avoid an unnecessary administrative burden and unnecessary costs, Error! Post not found for word:providers of a product that contains one or more high-Error! Post not found for word:risk Error! Post not found for word:ai system, to which the requirements of this Regulation and of the Union harmonisation legislation based on the New Legislative Framework and listed in an annex to this Regulation apply, should have flexibility with regard to operational decisions on how to ensure compliance of a product that contains one or more Error! Post not found for word:ai systems with all the applicable requirements of that Union harmonised legislation in an optimal manner. That flexibility could mean, for example a decision by the Error! Post not found for word:provider to integrate a part of the necessary testing and reporting processes, information and documentation required under this Regulation into already existing documentation and procedures required under existing Union harmonisation legislation based on the New Legislative Framework and listed in an annex to this Regulation. This should not, in any way, undermine the obligation of the Error! Post not found for word:provider to comply with all the applicable requirements.
(65) The Error! Post not found for word:risk-management system should consist of a continuous, iterative process that is planned and run throughout the entire lifecycle of a high-Error! Post not found for word:risk Error! Post not found for word:ai system. That process should be aimed at identifying and mitigating the relevant risks of Error! Post not found for word:ai systems on health, safety and fundamental rights. The Error! Post not found for word:risk-management system should be regularly reviewed and updated to ensure its continuing effectiveness, as well as justification and documentation of any significant decisions and actions taken Error! Post not found for word:subject to this Regulation. This process should ensure that the Error! Post not found for word:provider identifies risks or adverse impacts and implements mitigation measures for the known and reasonably foreseeable risks of Error! Post not found for word:ai systems to the health, safety and fundamental rights in light of their Error! Post not found for word:intended purpose and reasonably foreseeable misuse, including the possible risks arising from the interaction between the Error! Post not found for word:ai system and the environment within which it operates. The Error! Post not found for word:risk-management system should adopt the most appropriate Error! Post not found for word:risk-management measures in light of the state of the art in AI. When identifying the most appropriate Error! Post not found for word:risk-management measures, the Error! Post not found for word:provider should document and explain the choices made and, when relevant, involve experts and external stakeholders. In identifying the reasonably foreseeable misuse of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, the Error! Post not found for word:provider should cover uses of Error! Post not found for word:ai systems which, while not directly covered by the Error! Post not found for word:intended purpose and provided for in the instruction for use may nevertheless be reasonably expected to result from readily predictable human behaviour in the context of the specific characteristics and use of a particular Error! Post not found for word:ai system.
Any known or foreseeable circumstances related to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with its Error! Post not found for word:intended purpose or under conditions of reasonably foreseeable misuse, which may lead to risks to the health and safety or fundamental rights should be included in the instructions for use that are provided by the Error! Post not found for word:provider. This is to ensure that the Error! Post not found for word:deployer is aware and takes them into account when using the high-Error! Post not found for word:risk Error! Post not found for word:ai system. Identifying and implementing Error! Post not found for word:risk mitigation measures for foreseeable misuse under this Regulation should not require specific additional training for the high-Error! Post not found for word:risk Error! Post not found for word:ai system by the Error! Post not found for word:provider to address foreseeable misuse. The Error! Post not found for word:providers however are encouraged to consider such additional training measures to mitigate reasonable foreseeable misuses as necessary and appropriate.
(66) Requirements should apply to high-Error! Post not found for word:risk Error! Post not found for word:ai systems as regards Error! Post not found for word:risk management, the quality and relevance of Error! Post not found for word:data sets used, technical documentation and record-keeping, transparency and the provision of information to Error! Post not found for word:deployers, human oversight, and robustness, Error! Post not found for word:accuracy and Error! Post not found for word:cybersecurity. Those requirements are necessary to effectively mitigate the risks for health, safety and fundamental rights. As no other less trade restrictive measures are reasonably available, those requirements are not unjustified restrictions to trade.
(67) High-quality Error! Post not found for word:data and access to high-quality Error! Post not found for word:data plays a vital role in providing structure and in ensuring the performance of many Error! Post not found for word:ai systems, especially when techniques involving the training of models are used, with a view to ensure that the high-Error! Post not found for word:risk Error! Post not found for word:ai system performs as intended and safely and it does not become a source of discrimination prohibited by Union law. High-quality Error! Post not found for word:data sets for training, validation and testing require the implementation of appropriate Error! Post not found for word:data governance and management practices. Error! Post not found for word:data sets for training, validation and testing, including the labels, should be relevant, sufficiently representative, and to the best extent possible free of errors and complete in view of the Error! Post not found for word:intended purpose of the system. In order to facilitate compliance with Union Error! Post not found for word:data protection law, such as Regulation (EU) 2016/679, Error! Post not found for word:data governance and management practices should include, in the case of Error! Post not found for word:personal Error! Post not found for word:data, transparency about the original purpose of the Error! Post not found for word:data collection. The Error! Post not found for word:data sets should also have the appropriate statistical properties, including as regards the persons or groups of persons in relation to whom the high-Error! Post not found for word:risk Error! Post not found for word:ai system is intended to be used, with specific attention to the mitigation of possible biases in the Error! Post not found for word:data sets, that are likely to affect the health and safety of persons, have a negative impact on fundamental rights or lead to discrimination prohibited under Union law, especially where Error! Post not found for word:data outputs influence inputs for future operations (feedback loops). Biases can for example be inherent in underlying Error! Post not found for word:data sets, especially when historical Error! Post not found for word:data is being used, or generated when the systems are implemented in real world settings.
Results provided by Error! Post not found for word:ai systems could be influenced by such inherent biases that are inclined to gradually increase and thereby perpetuate and amplify existing discrimination, in particular for persons belonging to certain vulnerable groups, including racial or ethnic groups. The requirement for the Error! Post not found for word:data sets to be to the best extent possible complete and free of errors should not affect the use of privacy-preserving techniques in the context of the development and testing of Error! Post not found for word:ai systems. In particular, Error! Post not found for word:data sets should take into account, to the extent required by their Error! Post not found for word:intended purpose, the features, characteristics or elements that are particular to the specific geographical, contextual, behavioural or functional setting which the Error! Post not found for word:ai system is intended to be used. The requirements related to Error! Post not found for word:data governance can be complied with by having recourse to third parties that offer certified compliance services including verification of Error! Post not found for word:data governance, Error! Post not found for word:data set integrity, and Error! Post not found for word:data training, validation and testing practices, as far as compliance with the Error! Post not found for word:data requirements of this Regulation are ensured.
(68) For the development and assessment of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, certain actors, such as Error! Post not found for word:providers, notified bodies and other relevant entities, such as European Digital Innovation Hubs, testing experimentation facilities and researchers, should be able to access and use high-quality Error! Post not found for word:data sets within the fields of activities of those actors which are related to this Regulation. European common Error! Post not found for word:data spaces established by the Commission and the facilitation of Error! Post not found for word:data sharing between businesses and with government in the public interest will be instrumental to provide trustful, accountable and non-discriminatory access to high-quality Error! Post not found for word:data for the training, validation and testing of Error! Post not found for word:ai systems. For example, in health, the European Error! Post not found for word:health data space will facilitate non-discriminatory access to Error! Post not found for word:health data and the training of AI algorithms on those Error! Post not found for word:data sets, in a privacy-preserving, secure, timely, transparent and trustworthy manner, and with an appropriate institutional governance. Relevant competent authorities, including sectoral ones, providing or supporting the access to Error! Post not found for word:data may also support the provision of high-quality Error! Post not found for word:data for the training, validation and testing of Error! Post not found for word:ai systems.
(69) The right to privacy and to protection of Error! Post not found for word:personal Error! Post not found for word:data must be guaranteed throughout the entire lifecycle of the Error! Post not found for word:ai system. In this regard, the principles of Error! Post not found for word:data minimisation and Error! Post not found for word:data protection by design and by default, as set out in Union Error! Post not found for word:data protection law, are applicable when Error! Post not found for word:personal Error! Post not found for word:data are processed. Measures taken by Error! Post not found for word:providers to ensure compliance with those principles may include not only anonymisation and encryption, but also the use of technology that permits algorithms to be brought to the Error! Post not found for word:data and allows training of Error! Post not found for word:ai systems without the transmission between parties or copying of the raw or structured Error! Post not found for word:data themselves, without prejudice to the requirements on Error! Post not found for word:data governance provided for in this Regulation.
(70) In order to protect the right of others from the discrimination that might result from the bias in Error! Post not found for word:ai systems, the Error! Post not found for word:providers should, exceptionally, to the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-Error! Post not found for word:risk Error! Post not found for word:ai systems, Error! Post not found for word:subject to appropriate safeguards for the fundamental rights and freedoms of natural persons and following the application of all applicable conditions laid down under this Regulation in addition to the conditions laid down in Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, be able to process also special categories of personal data, as a matter of substantial public interest within the meaning of Article 9(2), point (g) of Regulation (EU) 2016/679 and Article 10(2), point (g) of Regulation (EU) 2018/1725.
(71) Having comprehensible information on how high-Error! Post not found for word:risk Error! Post not found for word:ai systems have been developed and how they perform throughout their lifetime is essential to enable traceability of those systems, verify compliance with the requirements under this Regulation, as well as monitoring of their operations and post market monitoring. This requires keeping records and the Error! Post not found for word:availability of technical documentation, containing information which is necessary to assess the compliance of the Error! Post not found for word:ai system with the relevant requirements and facilitate post market monitoring. Such information should include the general characteristics, capabilities and limitations of the system, algorithms, Error! Post not found for word:data, training, testing and validation processes used as well as documentation on the relevant Error! Post not found for word:risk-management system and drawn in a clear and comprehensive form. The technical documentation should be kept up to date, appropriately throughout the lifetime of the Error! Post not found for word:ai system. Furthermore, high-Error! Post not found for word:risk Error! Post not found for word:ai systems should technically allow for the automatic recording of events, by means of logs, over the duration of the lifetime of the system.
(72) To address concerns related to opacity and complexity of certain Error! Post not found for word:ai systems and help Error! Post not found for word:deployers to fulfil their obligations under this Regulation, transparency should be required for high-Error! Post not found for word:risk Error! Post not found for word:ai systems before they are placed on the market or put it into service. High-Error! Post not found for word:risk Error! Post not found for word:ai systems should be designed in a manner to enable Error! Post not found for word:deployers to understand how the Error! Post not found for word:ai system works, evaluate its functionality, and comprehend its strengths and limitations. High-Error! Post not found for word:risk Error! Post not found for word:ai systems, should be accompanied by appropriate information in the form of instructions of use. Such information should include the characteristics, capabilities and limitations of performance of the Error! Post not found for word:ai system. Those would cover information on possible known and foreseeable circumstances related to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, including Error! Post not found for word:deployer action that may influence system behaviour and performance, under which the Error! Post not found for word:ai system can lead to risks to health, safety, and fundamental rights, on the changes that have been pre-determined and assessed for conformity by the Error! Post not found for word:provider and on the relevant human oversight measures, including the measures to facilitate the interpretation of the outputs of the Error! Post not found for word:ai system by the Error! Post not found for word:deployers. Transparency, including the accompanying instructions for use, should assist Error! Post not found for word:deployers in the use of the system and support informed decision making by them. Error! Post not found for word:deployers should, inter alia, be in a better position to make the correct choice of the system that they intend to use in the of the obligations applicable to them, be educated about the intended and precluded uses, and use the Error! Post not found for word:ai system correctly and as appropriate. In order to enhance legibility and accessibility of the information included in the instructions of use, where appropriate, illustrative examples, for instance on the limitations and on the intended and precluded uses of the Error! Post not found for word:ai system, should be included. Error! Post not found for word:providers should ensure that all documentation, including the instructions for use, contains meaningful, comprehensive, accessible and understandable information, taking into account the needs and foreseeable knowledge of the target Error! Post not found for word:deployers. Instructions for use should be made available in a language which can be easily understood by target Error! Post not found for word:deployers, as determined by the Member State concerned.
(73) High-Error! Post not found for word:risk Error! Post not found for word:ai systems should be designed and developed in such a way that natural persons can oversee their functioning, ensure that they are used as intended and that their impacts are addressed over the system’s lifecycle. To that end, appropriate human oversight measures should be identified by the Error! Post not found for word:provider of the system before its placing on the market or putting into service. In particular, where appropriate, such measures should guarantee that the system is Error! Post not found for word:subject to in-built operational constraints that cannot be overridden by the system itself and is responsive to the human Error! Post not found for word:operator, and that the natural persons to whom human oversight has been assigned have the necessary competence, training and authority to carry out that role. It is also essential, as appropriate, to ensure that high-Error! Post not found for word:risk Error! Post not found for word:ai systems include mechanisms to guide and inform a natural person to whom human oversight has been assigned to make informed decisions if, when and how to intervene in order to avoid negative consequences or risks, or stop the system if it does not perform as intended. Considering the significant consequences for persons in the case of an incorrect match by certain biometric identification systems, it is appropriate to provide for an enhanced human oversight requirement for those systems so that no action or decision may be taken by the Error! Post not found for word:deployer on the basis of the identification resulting from the system unless this has been separately verified and confirmed by at least two natural persons. Those persons could be from one or more entities and include the person operating or using the system. This requirement should not pose unnecessary burden or delays and it could be sufficient that the separate verifications by the different persons are automatically recorded in the logs generated by the system. Given the specificities of the areas of Error! Post not found for word:law enforcement, migration, border control and asylum, this requirement should not apply where Union or national law considers the application of that requirement to be disproportionate.
(74) High-Error! Post not found for word:risk Error! Post not found for word:ai systems should perform consistently throughout their lifecycle and meet an appropriate level of Error! Post not found for word:accuracy, robustness and Error! Post not found for word:cybersecurity, in light of their Error! Post not found for word:intended purpose and in accordance with the generally acknowledged state of the art. The Commission and relevant organisations and stakeholders are encouraged to take due consideration of the mitigation of risks and the negative impacts of the Error! Post not found for word:ai system. The expected level of performance metrics should be declared in the accompanying instructions of use. Error! Post not found for word:providers are urged to communicate that information to Error! Post not found for word:deployers in a clear and easily understandable way, free of misunderstandings or misleading statements. Union law on legal metrology, including Directives 2014/31/EU(39) and 2014/32/EU(40) of the European Parliament and of the Council, aims to ensure the Error! Post not found for word:accuracy of measurements and to help the transparency and fairness of commercial transactions. In that context, in cooperation with relevant stakeholders and organisation, such as metrology and benchmarking authorities, the Commission should encourage, as appropriate, the development of benchmarks and measurement methodologies for Error! Post not found for word:ai systems. In doing so, the Commission should take note and collaborate with international partners working on metrology and relevant measurement indicators relating to AI.
(75) Technical robustness is a key requirement for high-Error! Post not found for word:risk Error! Post not found for word:ai systems. They should be resilient in relation to harmful or otherwise undesirable behaviour that may result from limitations within the systems or the environment in which the systems operate (e.g. errors, faults, inconsistencies, unexpected situations). Therefore, technical and organisational measures should be taken to ensure robustness of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, for example by designing and developing appropriate technical solutions to prevent or minimise harmful or otherwise undesirable behaviour. Those technical solution may include for instance mechanisms enabling the system to safely interrupt its operation (fail-safe plans) in the presence of certain anomalies or when operation takes place outside certain predetermined boundaries. Failure to protect against these risks could lead to safety impacts or negatively affect the fundamental rights, for example due to erroneous decisions or wrong or biased outputs generated by the Error! Post not found for word:ai system.
(76) Error! Post not found for word:cybersecurity plays a crucial role in ensuring that Error! Post not found for word:ai systems are resilient against attempts to alter their use, behaviour, performance or compromise their security properties by malicious third parties exploiting the system’s vulnerabilities. Cyberattacks against Error! Post not found for word:ai systems can leverage AI specific assets, such as Error! Post not found for word:training Error! Post not found for word:data sets (e.g. Error! Post not found for word:data poisoning) or trained models (e.g. adversarial attacks or membership inference), or exploit vulnerabilities in the Error! Post not found for word:ai system’s Error! Post not found for word:digital assets or the underlying ICT infrastructure. To ensure a level of Error! Post not found for word:cybersecurity appropriate to the risks, suitable measures, such as security controls, should therefore be taken by the Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, also taking into account as appropriate the underlying ICT infrastructure.
(77) Without prejudice to the requirements related to robustness and Error! Post not found for word:accuracy set out in this Regulation, high-Error! Post not found for word:risk Error! Post not found for word:ai systems which fall within the scope of a Regulation of the European Parliament and of the Council on honrizontal Error! Post not found for word:cybersecurity requirements for products with digital elements, in accordance with that regulation may demonstrate compliance with the Error! Post not found for word:cybersecurity requirements of this Regulation by fulfilling the essential Error! Post not found for word:cybersecurity requirements set out that regulation. When high-Error! Post not found for word:risk Error! Post not found for word:ai systems fulfil the essential requirements of a regulation of the European Parliament and of the Council on horizontal Error! Post not found for word:cybersecurity requirements for products with digital elements, they should be deemed compliant with the Error! Post not found for word:cybersecurity requirements set out in this Regulation in so far as the achievement of those requirements is demonstrated in the EU declaration of conformity or parts thereof issued under that regulation. To that end, the assessment of the Error! Post not found for word:cybersecurity risks, associated to a product with digital elements classified as high-Error! Post not found for word:risk Error! Post not found for word:ai system according to this Regulation, carried out under a regulation of the European Parliament and of the Council on horizontal Error! Post not found for word:cybersecurity requirements for products with digital elements, should consider risks to the cyber resilience of an Error! Post not found for word:ai system as regards attempts by unauthorised third parties to alter its use, behaviour or performance, including AI specific vulnerabilities such as Error! Post not found for word:data poisoning or adversarial attacks, as well as, as relevant, risks to fundamental rights as required by this Regulation.
(78) The conformity assessment procedure provided by this Regulation should apply in relation to the essential Error! Post not found for word:cybersecurity requirements of a product with digital elements covered by a regulation of the European Parliament and of the Council on horizontal Error! Post not found for word:cybersecurity requirements for products with digital elements and classified as a high-Error! Post not found for word:risk Error! Post not found for word:ai system under this Regulation. However, this rule should not result in reducing the necessary level of assurance for critical products with digital elements covered by a regulation of the European Parliament and of the Council on horizontal Error! Post not found for word:cybersecurity requirements for products with digital elements. Therefore, by way of derogation from this rule, high-Error! Post not found for word:risk Error! Post not found for word:ai systems that fall within the scope of this Regulation and are also qualified as important and critical products with digital elements pursuant to a regulation of the European Parliament and of the Council on horizontal Error! Post not found for word:cybersecurity requirements for products with digital elements and to which the conformity assessment procedure based on internal control set out in an annex to this Regulation applies, are Error! Post not found for word:subject to the conformity assessment provisions of a regulation of the European Parliament and of the Council on horizontal Error! Post not found for word:cybersecurity requirements for products with digital elements insofar as the essential Error! Post not found for word:cybersecurity requirements of that regulation are concerned. In this case, for all the other aspects covered by this Regulation the respective provisions on conformity assessment based on internal control set out in an annex to this Regulation should apply. Building on the knowledge and expertise of ENISA on the Error! Post not found for word:cybersecurity policy and tasks assigned to ENISA under the Regulation (EU) 2019/881 of the European Parliament and of the Council (37), the Commission should cooperate with ENISA on issues related to Error! Post not found for word:cybersecurity of Error! Post not found for word:ai systems.
(79) It is appropriate that a specific natural or legal person, defined as the Error! Post not found for word:provider, takes responsibility for the placing on the market or the putting into service of a high-Error! Post not found for word:risk Error! Post not found for word:ai system, regardless of whether that natural or legal person is the person who designed or developed the system.
(80) As signatories to the United Nations Convention on the Rights of Persons with Disabilities, the Union and the Member States are legally obliged to protect persons with disabilities from discrimination and promote their equality, to ensure that persons with disabilities have access, on an equal basis with others, to information and communications technologies and systems, and to ensure respect for privacy for persons with disabilities. Given the growing importance and use of Error! Post not found for word:ai systems, the application of universal design principles to all new technologies and services should ensure full and equal access for everyone potentially affected by or using AI technologies, including persons with disabilities, in a way that takes full account of their inherent dignity and diversity. It is therefore essential that Error! Post not found for word:providers ensure full compliance with accessibility requirements, including Directive (EU) 2016/2102 of the European Parliament and of the Council(44) and Directive (EU) 2019/882. Error! Post not found for word:providers should ensure compliance with these requirements by design. Therefore, the necessary measures should be integrated as much as possible into the design of the high-Error! Post not found for word:risk Error! Post not found for word:ai system.
(81) The Error! Post not found for word:provider should establish a sound quality management system, ensure the accomplishment of the required conformity assessment procedure, draw up the relevant documentation and establish a robust post-market monitoring system. Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are Error! Post not found for word:subject to obligations regarding quality management systems under relevant sectoral Union law should have the possibility to include the elements of the quality management system provided for in this Regulation as part of the existing quality management system provided for in that other sectoral Union law. The complementarity between this Regulation and existing sectoral Union law should also be taken into account in future standardisation activities or guidance adopted by the Commission. Public authorities which put into service high-Error! Post not found for word:risk Error! Post not found for word:ai systems for their own use may adopt and implement the rules for the quality management system as part of the quality management system adopted at a national or regional level, as appropriate, taking into account the specificities of the sector and the competences and organisation of the public authority concerned.
(82) To enable enforcement of this Regulation and create a level playing field for Error! Post not found for word:operators, and taking into account the different forms of making available of digital products, it is important to ensure that, under all circumstances, a person established in the Union can provide authorities with all the necessary information on the compliance of an Error! Post not found for word:ai system. Therefore, prior to making their Error! Post not found for word:ai systems available in the Union, Error! Post not found for word:providers established in third countries should, by written mandate, appoint an authorised representative established in the Union. This authorised representative plays a pivotal role in ensuring the compliance of the high-Error! Post not found for word:risk Error! Post not found for word:ai systems placed on the market or put into service in the Union by those Error! Post not found for word:providers who are not established in the Union and in serving as their contact person established in the Union.
(83) In light of the nature and complexity of the value chain for Error! Post not found for word:ai systems and in line with the New Legislative Framework, it is essential to ensure legal certainty and facilitate the compliance with this Regulation. Therefore, it is necessary to clarify the role and the specific obligations of relevant Error! Post not found for word:operators along that value chain, such as Error! Post not found for word:importers and Error! Post not found for word:distributors who may contribute to the development of Error! Post not found for word:ai systems. In certain situations those Error! Post not found for word:operators could act in more than one role at the same time and should therefore fulfil cumulatively all relevant obligations associated with those roles. For example, an Error! Post not found for word:operator could act as a Error! Post not found for word:distributor and an Error! Post not found for word:importer at the same time.
(84) To ensure legal certainty, it is necessary to clarify that, under certain specific conditions, any Error! Post not found for word:distributor, Error! Post not found for word:importer, Error! Post not found for word:deployer or other third-party should be considered to be a Error! Post not found for word:provider of a high-Error! Post not found for word:risk Error! Post not found for word:ai system and therefore assume all the relevant obligations. This would be the case if that party puts its name or trademark on a high-Error! Post not found for word:risk Error! Post not found for word:ai system already placed on the market or put into service, without prejudice to contractual arrangements stipulating that the obligations are allocated otherwise. This would also be the case if that party makes a substantial modification to a high-Error! Post not found for word:risk Error! Post not found for word:ai system that has already been placed on the market or has already been put into service in a way that it remains a high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with this Regulation, or if it modifies the Error! Post not found for word:intended purpose of an Error! Post not found for word:ai system, including a general-purpose AI system, which has not been classified as high-Error! Post not found for word:risk and has already been placed on the market or put into service, in a way that the Error! Post not found for word:ai system becomes a high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with this Regulation. Those provisions should apply without prejudice to more specific provisions established in certain Union harmonisation legislation based on the New Legislative Framework, together with which this Regulation should apply. For example, Article 16(2) of Regulation (EU) 2017/745, establishing that certain changes should not be considered to be modifications of a device that could affect its compliance with the applicable requirements, should continue to apply to high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are medical devices within the meaning of that Regulation.
(85) General-purpose AI systems may be used as high-Error! Post not found for word:risk Error! Post not found for word:ai systems by themselves or be components of other high-Error! Post not found for word:risk Error! Post not found for word:ai systems. Therefore, due to their particular nature and in order to ensure a fair sharing of responsibilities along the AI value chain, the Error! Post not found for word:providers of such systems should, irrespective of whether they may be used as high-Error! Post not found for word:risk Error! Post not found for word:ai systems as such by other Error! Post not found for word:providers or as components of high-Error! Post not found for word:risk Error! Post not found for word:ai systems and unless provided otherwise under this Regulation, closely cooperate with the Error! Post not found for word:providers of the relevant high-Error! Post not found for word:risk Error! Post not found for word:ai systems to enable their compliance with the relevant obligations under this Regulation and with the competent authorities established under this Regulation.
(86) Where, under the conditions laid down in this Regulation, the Error! Post not found for word:provider that initially placed the Error! Post not found for word:ai system on the market or put it into service should no longer be considered to be the Error! Post not found for word:provider for the purposes of this Regulation, and when that Error! Post not found for word:provider has not expressly excluded the change of the Error! Post not found for word:ai system into a high-Error! Post not found for word:risk Error! Post not found for word:ai system, the former Error! Post not found for word:provider should nonetheless closely cooperate and make available the necessary information and provide the reasonably expected technical access and other assistance that are required for the fulfilment of the obligations set out in this Regulation, in particular regarding the compliance with the conformity assessment of high-Error! Post not found for word:risk Error! Post not found for word:ai systems.
(87) In addition, where a high-Error! Post not found for word:risk Error! Post not found for word:ai system that is a safety component of a product which falls within the scope of Union harmonisation legislation based on the New Legislative Framework is not placed on the market or put into service independently from the product, the product Error! Post not found for word:manufacturer defined in that legislation should comply with the obligations of the Error! Post not found for word:provider established in this Regulation and should, in particular, ensure that the Error! Post not found for word:ai system embedded in the final product complies with the requirements of this Regulation.
(88) Along the AI value chain multiple parties often supply Error! Post not found for word:ai systems, tools and services but also components or processes that are incorporated by the Error! Post not found for word:provider into the Error! Post not found for word:ai system with various objectives, including the model training, model retraining, model testing and evaluation, integration into Error! Post not found for word:software, or other aspects of model development. Those parties have an important role to play in the value chain towards the Error! Post not found for word:provider of the high-Error! Post not found for word:risk Error! Post not found for word:ai system into which their Error! Post not found for word:ai systems, tools, services, components or processes are integrated, and should provide by written agreement this Error! Post not found for word:provider with the necessary information, capabilities, technical access and other assistance based on the generally acknowledged state of the art, in order to enable the Error! Post not found for word:provider to fully comply with the obligations set out in this Regulation, without compromising their own intellectual property rights or trade secrets.
(89) Third parties making accessible to the public tools, services, processes, or AI components other than general-purpose AI models, should not be mandated to comply with requirements targeting the responsibilities along the AI value chain, in particular towards the Error! Post not found for word:provider that has used or integrated them, when those tools, services, processes, or AI components are made accessible under a free and open-source licence. Developers of free and open-source tools, services, processes, or AI components other than general-purpose AI models should be encouraged to implement widely adopted documentation practices, such as model cards and Error! Post not found for word:data sheets, as a way to accelerate information sharing along the AI value chain, allowing the promotion of trustworthy Error! Post not found for word:ai systems in the Union.
(90) The Commission could develop and recommend voluntary model contractual terms between Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems and third parties that supply tools, services, components or processes that are used or integrated in high-Error! Post not found for word:risk Error! Post not found for word:ai systems, to facilitate the cooperation along the value chain. When developing voluntary model contractual terms, the Commission should also take into account possible contractual requirements applicable in specific sectors or business cases.
(91) Given the nature of Error! Post not found for word:ai systems and the risks to safety and fundamental rights possibly associated with their use, including as regards the need to ensure proper monitoring of the performance of an AI system in a real-life setting, it is appropriate to set specific responsibilities for Error! Post not found for word:deployers. Error! Post not found for word:deployers should in particular take appropriate technical and organisational measures to ensure they use high-Error! Post not found for word:risk Error! Post not found for word:ai systems in accordance with the instructions of use and certain other obligations should be provided for with regard to monitoring of the functioning of the Error! Post not found for word:ai systems and with regard to record-keeping, as appropriate. Furthermore, Error! Post not found for word:deployers should ensure that the persons assigned to implement the instructions for use and human oversight as set out in this Regulation have the necessary competence, in particular an adequate level of Error! Post not found for word:ai literacy, training and authority to properly fulfil those tasks. Those obligations should be without prejudice to other Error! Post not found for word:deployer obligations in relation to high-Error! Post not found for word:risk Error! Post not found for word:ai systems under Union or national law.
(92) This Regulation is without prejudice to obligations for employers to inform or to inform and consult workers or their Error! Post not found for word:representatives under Union or national law and practice, including Directive 2002/14/EC of the European Parliament and of the Council(45), on decisions to put into service or use Error! Post not found for word:ai systems. It remains necessary to ensure information of workers and their Error! Post not found for word:representatives on the planned deployment of high-Error! Post not found for word:risk Error! Post not found for word:ai systems at the workplace where the conditions for those information or information and consultation obligations in other legal instruments are not fulfilled. Moreover, such information right is ancillary and necessary to the objective of protecting fundamental rights that underlies this Regulation. Therefore, an information requirement to that effect should be laid down in this Regulation, without affecting any existing rights of workers.
(93) Whilst risks related to Error! Post not found for word:ai systems can result from the way such systems are designed, risks can as well stem from how such Error! Post not found for word:ai systems are used. Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai system therefore play a critical role in ensuring that fundamental rights are protected, complementing the obligations of the Error! Post not found for word:provider when developing the Error! Post not found for word:ai system. Error! Post not found for word:deployers are best placed to understand how the high-Error! Post not found for word:risk Error! Post not found for word:ai system will be used concretely and can therefore identify potential significant risks that were not foreseen in the development phase, due to a more precise knowledge of the context of use, the persons or groups of persons likely to be affected, including vulnerable groups. Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in an annex to this Regulation also play a critical role in informing natural persons and should, when they make decisions or assist in making decisions related to natural persons, where applicable, inform the natural persons that they are Error! Post not found for word:subject to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system. This information should include the Error! Post not found for word:intended purpose and the type of decisions it makes. The Error! Post not found for word:deployer should also inform the natural persons about their right to an explanation provided under this Regulation. With regard to high-Error! Post not found for word:risk Error! Post not found for word:ai systems used for Error! Post not found for word:law enforcement purposes, that obligation should be implemented in accordance with Article 13 of Directive (EU) 2016/680.
(94) Any Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data involved in the use of Error! Post not found for word:ai systems for biometric identification for the purpose of Error! Post not found for word:law enforcement needs to comply with Article 10 of Directive (EU) 2016/680, that allows such Error! Post not found for word:processing only where strictly necessary, Error! Post not found for word:subject to appropriate safeguards for the rights and freedoms of the Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subject, and where authorised by Union or Member State law. Such use, when authorised, also needs to respect the principles laid down in Article 4 (1) of Directive (EU) 2016/680 including lawfulness, fairness and transparency, purpose limitation, Error! Post not found for word:accuracy and storage limitation.
(95) Without prejudice to applicable Union law, in particular Regulation (EU) 2016/679 and Directive (EU) 2016/680, considering the intrusive nature of post-remote biometric identification systems, the use of post-remote biometric identification systems should be Error! Post not found for word:subject to safeguards. Post-biometric identification systems should always be used in a way that is proportionate, legitimate and strictly necessary, and thus targeted, in terms of the individuals to be identified, the location, temporal scope and based on a closed Error! Post not found for word:data set of legally acquired video footage. In any case, post-remote biometric identification systems should not be used in the framework of Error! Post not found for word:law enforcement to lead to indiscriminate surveillance. The conditions for post-remote biometric identification should in any case not provide a basis to circumvent the conditions of the prohibition and strict exceptions for real time remote biometric identification.
(96) In order to efficiently ensure that fundamental rights are protected, Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are bodies governed by public law, or private entities providing public services and Error! Post not found for word:deployers of certain high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in an annex to this Regulation, such as banking or insurance entities, should carry out a fundamental rights impact assessment prior to putting it into use. Services important for individuals that are of public nature may also be provided by private entities. Private entities providing such public services are linked to tasks in the public interest such as in the areas of education, healthcare, social services, housing, administration of justice. The aim of the fundamental rights impact assessment is for the Error! Post not found for word:deployer to identify the specific risks to the rights of individuals or groups of individuals likely to be affected, identify measures to be taken in the case of a materialisation of those risks. The impact assessment should be performed prior to deploying the high-Error! Post not found for word:risk Error! Post not found for word:ai system, and should be updated when the Error! Post not found for word:deployer considers that any of the relevant factors have changed. The impact assessment should identify the Error! Post not found for word:deployer’s relevant processes in which the high-Error! Post not found for word:risk Error! Post not found for word:ai system will be used in line with its Error! Post not found for word:intended purpose, and should include a description of the period of time and frequency in which the system is intended to be used as well as of specific categories of natural persons and groups who are likely to be affected in the specific context of use.
The assessment should also include the identification of specific risks of harm likely to have an impact on the fundamental rights of those persons or groups. While performing this assessment, the Error! Post not found for word:deployer should take into account information relevant to a proper assessment of the impact, including but not limited to the information given by the Error! Post not found for word:provider of the high-Error! Post not found for word:risk Error! Post not found for word:ai system in the instructions for use. In light of the risks identified, Error! Post not found for word:deployers should determine measures to be taken in the case of a materialisation of those risks, including for example governance arrangements in that specific context of use, such as arrangements for human oversight according to the instructions of use or, complaint handling and redress procedures, as they could be instrumental in mitigating risks to fundamental rights in concrete use-cases. After performing that impact assessment, the Error! Post not found for word:deployer should notify the relevant market surveillance authority. Where appropriate, to collect relevant information necessary to perform the impact assessment, Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai system, in particular when Error! Post not found for word:ai systems are used in the public sector, could involve relevant stakeholders, including the Error! Post not found for word:representatives of groups of persons likely to be affected by the Error! Post not found for word:ai system, independent experts, and civil society organisations in conducting such impact assessments and designing measures to be taken in the case of materialisation of the risks. The European Artificial Intelligence Office (‘Error! Post not found for word:ai office’) should develop a template for a questionnaire in order to facilitate compliance and reduce the administrative burden for Error! Post not found for word:deployers.
(97) The notion of general-purpose AI models should be clearly defined and set apart from the notion of Error! Post not found for word:ai systems to enable legal certainty. The definition should be based on the key functional characteristics of a general-purpose AI model, in particular the generality and the capability to competently perform a wide range of distinct tasks. These models are typically trained on large amounts of Error! Post not found for word:data, through various methods, such as self-supervised, unsupervised or reinforcement learning. General-purpose AI models may be placed on the market in various ways, including through libraries, application programming interfaces (APIs), as direct download, or as physical copy. These models may be further modified or fine-tuned into new models. Although AI models are essential components of Error! Post not found for word:ai systems, they do not constitute Error! Post not found for word:ai systems on their own. AI models require the addition of further components, such as for example a Error! Post not found for word:user interface, to become Error! Post not found for word:ai systems. AI models are typically integrated into and form part of Error! Post not found for word:ai systems. This Regulation provides specific rules for general-purpose AI models and for general-purpose AI models that pose Error! Post not found for word:systemic risks, which should apply also when these models are integrated or form part of an Error! Post not found for word:ai system. It should be understood that the obligations for the Error! Post not found for word:providers of general-purpose AI models should apply once the general-purpose AI models are placed on the market.
When the Error! Post not found for word:provider of a general-purpose AI model integrates an own model into its own Error! Post not found for word:ai system that is made available on the market or put into service, that model should be considered to be placed on the market and, therefore, the obligations in this Regulation for models should continue to apply in addition to those for Error! Post not found for word:ai systems. The obligations laid down for models should in any case not apply when an own model is used for purely internal processes that are not essential for providing a product or a service to third parties and the rights of natural persons are not affected. Considering their potential significantly negative effects, the general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk should always be Error! Post not found for word:subject to the relevant obligations under this Regulation. The definition should not cover AI models used before their placing on the market for the sole purpose of research, development and prototyping activities. This is without prejudice to the obligation to comply with this Regulation when, following such activities, a model is placed on the market.
(98) Whereas the generality of a model could, inter alia, also be determined by a number of parameters, models with at least a billion of parameters and trained with a large amount of Error! Post not found for word:data using self-supervision at scale should be considered to display significant generality and to competently perform a wide range of distinctive tasks.
(99) Large generative AI models are a typical example for a general-purpose AI model, given that they allow for flexible generation of content, such as in the form of text, audio, images or video, that can readily accommodate a wide range of distinctive tasks.
(100) When a general-purpose AI model is integrated into or forms part of an Error! Post not found for word:ai system, this system should be considered to be general-purpose AI system when, due to this integration, this system has the capability to serve a variety of purposes. A general-purpose AI system can be used directly, or it may be integrated into other Error! Post not found for word:ai systems.
(101) Error! Post not found for word:providers of general-purpose AI models have a particular role and responsibility along the AI value chain, as the models they provide may form the basis for a range of downstream systems, often provided by downstream providers that necessitate a good understanding of the models and their capabilities, both to enable the integration of such models into their products, and to fulfil their obligations under this or other regulations. Therefore, proportionate transparency measures should be laid down, including the drawing up and keeping up to date of documentation, and the provision of information on the general-purpose AI model for its usage by the downstream providers. Technical documentation should be prepared and kept up to date by the general-purpose AI model Error! Post not found for word:provider for the purpose of making it available, upon request, to the Error! Post not found for word:ai office and the national competent authorities. The minimal set of elements to be included in such documentation should be set out in specific annexes to this Regulation. The Commission should be empowered to amend those annexes by means of delegated acts in light of evolving technological developments.
(102) Error! Post not found for word:software and Error! Post not found for word:data, including models, released under a free and open-source licence that allows them to be openly shared and where users can freely access, use, modify and redistribute them or modified versions thereof, can contribute to research and innovation in the market and can provide significant growth opportunities for the Union economy. General-purpose AI models released under free and open-source licences should be considered to ensure high levels of transparency and openness if their parameters, including the weights, the information on the model architecture, and the information on model usage are made publicly available. The licence should be considered to be free and open-source also when it allows users to run, copy, distribute, study, change and improve Error! Post not found for word:software and Error! Post not found for word:data, including models under the condition that the original Error! Post not found for word:provider of the model is credited, the identical or comparable terms of distribution are respected.
(103) Free and open-source AI components covers the Error! Post not found for word:software and Error! Post not found for word:data, including models and general-purpose AI models, tools, services or processes of an Error! Post not found for word:ai system. Free and open-source AI components can be provided through different channels, including their development on open repositories. For the purposes of this Regulation, AI components that are provided against a price or otherwise monetised, including through the provision of technical support or other services, including through a Error! Post not found for word:software platform, related to the AI Error! Post not found for word:component, or the use of Error! Post not found for word:personal Error! Post not found for word:data for reasons other than exclusively for improving the security, compatibility or Error! Post not found for word:interoperability of the Error! Post not found for word:software, with the exception of transactions between microenterprises, should not benefit from the exceptions provided to free and open-source AI components. The fact of making AI components available through open repositories should not, in itself, constitute a monetisation.
(104) The Error! Post not found for word:providers of general-purpose AI models that are released under a free and open-source licence, and whose parameters, including the weights, the information on the model architecture, and the information on model usage, are made publicly available should be Error! Post not found for word:subject to exceptions as regards the transparency-related requirements imposed on general-purpose AI models, unless they can be considered to present a Error! Post not found for word:systemic Error! Post not found for word:risk, in which case the circumstance that the model is transparent and accompanied by an open-source license should not be considered to be a sufficient reason to exclude compliance with the obligations under this Regulation. In any case, given that the release of general-purpose AI models under free and open-source licence does not necessarily reveal substantial information on the Error! Post not found for word:data set used for the training or fine-tuning of the model and on how compliance of copyright law was thereby ensured, the exception provided for general-purpose AI models from compliance with the transparency-related requirements should not concern the obligation to produce a summary about the content used for model training and the obligation to put in place a policy to comply with Union copyright law, in particular to identify and comply with the reservation of rights pursuant to Article 4(3) of Directive (EU) 2019/790 of the European Parliament and of the Council(46).
(105) General-purpose AI models, in particular large generative AI models, capable of generating text, images, and other content, present unique innovation opportunities but also challenges to artists, authors, and other creators and the way their creative content is created, distributed, used and consumed. The development and training of such models require access to vast amounts of text, images, videos, and other Error! Post not found for word:data. Text and Error! Post not found for word:data mining techniques may be used extensively in this context for the retrieval and analysis of such content, which may be protected by copyright and related rights. Any use of copyright protected content requires the authorisation of the rightsholder concerned unless relevant copyright exceptions and limitations apply. Directive (EU) 2019/790 introduced exceptions and limitations allowing reproductions and extractions of works or other Error! Post not found for word:subject matter, for the purpose of text and Error! Post not found for word:data mining, under certain conditions. Under these rules, rightsholders may choose to reserve their rights over their works or other Error! Post not found for word:subject matter to prevent text and Error! Post not found for word:data mining, unless this is done for the purposes of scientific research. Where the rights to opt out has been expressly reserved in an appropriate manner, Error! Post not found for word:providers of general-purpose AI models need to obtain an authorisation from rightsholders if they want to carry out text and Error! Post not found for word:data mining over such works.
(106) Error! Post not found for word:providers that place general-purpose AI models on the Union market should ensure compliance with the relevant obligations in this Regulation. To that end, Error! Post not found for word:providers of general-purpose AI models should put in place a policy to comply with Union law on copyright and related rights, in particular to identify and comply with the reservation of rights expressed by rightsholders pursuant to Article 4(3) of Directive (EU) 2019/790. Any Error! Post not found for word:provider placing a general-purpose AI model on the Union market should comply with this obligation, regardless of the jurisdiction in which the copyright-relevant acts underpinning the training of those general-purpose AI models take place. This is necessary to ensure a level playing field among Error! Post not found for word:providers of general-purpose AI models where no Error! Post not found for word:provider should be able to gain a competitive advantage in the Union market by applying lower copyright standards than those provided in the Union.
(107) In order to increase transparency on the Error! Post not found for word:data that is used in the pre-training and training of general-purpose AI models, including text and Error! Post not found for word:data protected by copyright law, it is adequate that Error! Post not found for word:providers of such models draw up and make publicly available a sufficiently detailed summary of the content used for training the general-purpose AI model. While taking into due account the need to protect trade secrets and confidential business information, this summary should be generally comprehensive in its scope instead of technically detailed to facilitate parties with legitimate interests, including copyright holders, to exercise and enforce their rights under Union law, for example by listing the main Error! Post not found for word:data collections or sets that went into training the model, such as large private or public databases or Error! Post not found for word:data archives, and by providing a narrative explanation about other Error! Post not found for word:data sources used. It is appropriate for the Error! Post not found for word:ai office to provide a template for the summary, which should be simple, effective, and allow the Error! Post not found for word:provider to provide the required summary in narrative form.
(108) With regard to the obligations imposed on Error! Post not found for word:providers of general-purpose AI models to put in place a policy to comply with Union copyright law and make publicly available a summary of the content used for the training, the Error! Post not found for word:ai office should monitor whether the Error! Post not found for word:provider has fulfilled those obligations without verifying or proceeding to a work-by-work assessment of the Error! Post not found for word:training Error! Post not found for word:data in terms of copyright compliance. This Regulation does not affect the enforcement of copyright rules as provided for under Union law.
(109) Compliance with the obligations applicable to the Error! Post not found for word:providers of general-purpose AI models should be commensurate and proportionate to the type of model Error! Post not found for word:provider, excluding the need for compliance for persons who develop or use models for non-professional or scientific research purposes, who should nevertheless be encouraged to voluntarily comply with these requirements. Without prejudice to Union copyright law, compliance with those obligations should take due account of the size of the Error! Post not found for word:provider and allow simplified ways of compliance for SMEs, including start-ups, that should not represent an excessive cost and not discourage the use of such models. In the case of a modification or fine-tuning of a model, the obligations for Error! Post not found for word:providers of general-purpose AI models should be limited to that modification or fine-tuning, for example by complementing the already existing technical documentation with information on the modifications, including new Error! Post not found for word:training Error! Post not found for word:data sources, as a means to comply with the value chain obligations provided in this Regulation.
(110) General-purpose AI models could pose Error! Post not found for word:systemic risks which include, but are not limited to, any actual or reasonably foreseeable negative effects in relation to major accidents, disruptions of critical sectors and serious consequences to public health and safety; any actual or reasonably foreseeable negative effects on democratic processes, public and economic security; the dissemination of illegal, false, or discriminatory content. Error! Post not found for word:systemic risks should be understood to increase with model capabilities and model reach, can arise along the entire lifecycle of the model, and are influenced by conditions of misuse, model reliability, model fairness and model security, the level of autonomy of the model, its access to tools, novel or combined modalities, release and distribution strategies, the potential to remove guardrails and other factors. In particular, international approaches have so far identified the need to pay attention to risks from potential intentional misuse or unintended issues of control relating to alignment with human intent; chemical, biological, radiological, and nuclear risks, such as the ways in which barriers to entry can be lowered, including for weapons development, design acquisition, or use; offensive cyber capabilities, such as the ways in Error! Post not found for word:vulnerability discovery, exploitation, or operational use can be enabled; the effects of interaction and tool use, including for example the capacity to control physical systems and interfere with critical infrastructure; risks from models of making copies of themselves or ‘self-replicating’ or training other models; the ways in which models can give rise to harmful bias and discrimination with risks to individuals, communities or societies; the facilitation of disinformation or harming privacy with threats to democratic values and human rights; Error! Post not found for word:risk that a particular event could lead to a chain reaction with considerable negative effects that could affect up to an entire city, an entire domain activity or an entire community.
(111) It is appropriate to establish a methodology for the classification of general-purpose AI models as general-purpose AI model with Error! Post not found for word:systemic risks. Since Error! Post not found for word:systemic risks result from particularly high capabilities, a general-purpose AI model should be considered to present Error! Post not found for word:systemic risks if it has high-impact capabilities, evaluated on the basis of appropriate technical tools and methodologies, or significant impact on the internal market due to its reach. High-impact capabilities in general-purpose AI models means capabilities that match or exceed the capabilities recorded in the most advanced general-purpose AI models. The full range of capabilities in a model could be better understood after its placing on the market or when Error! Post not found for word:deployers interact with the model. According to the state of the art at the time of entry into force of this Regulation, the cumulative amount of computation used for the training of the general-purpose AI model measured in floating point operations is one of the relevant approximations for model capabilities. The cumulative amount of computation used for training includes the computation used across the activities and methods that are intended to enhance the capabilities of the model prior to deployment, such as pre-training, synthetic Error! Post not found for word:data generation and fine-tuning. Therefore, an initial threshold of floating point operations should be set, which, if met by a general-purpose AI model, leads to a presumption that the model is a general-purpose AI model with Error! Post not found for word:systemic risks. This threshold should be adjusted over time to reflect technological and industrial changes, such as algorithmic improvements or increased Error! Post not found for word:hardware efficiency, and should be supplemented with benchmarks and indicators for model capability.
To inform this, the Error! Post not found for word:ai office should engage with the scientific community, industry, civil society and other experts. Thresholds, as well as tools and benchmarks for the assessment of high-impact capabilities, should be strong predictors of generality, its capabilities and associated Error! Post not found for word:systemic Error! Post not found for word:risk of general-purpose AI models, and could take into account the way the model will be placed on the market or the number of users it may affect. To complement this system, there should be a possibility for the Commission to take individual decisions designating a general-purpose AI model as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk if it is found that such model has capabilities or an impact equivalent to those captured by the set threshold. That decision should be taken on the basis of an overall assessment of the criteria for the designation of a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk set out in an annex to this Regulation, such as quality or size of the Error! Post not found for word:training Error! Post not found for word:data set, number of business and Error! Post not found for word:end users, its input and output modalities, its level of autonomy and scalability, or the tools it has access to. Upon a reasoned request of a Error! Post not found for word:provider whose model has been designated as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk, the Commission should take the request into account and may decide to reassess whether the general-purpose AI model can still be considered to present Error! Post not found for word:systemic risks.
(112) It is also necessary to clarify a procedure for the classification of a general-purpose AI model with Error! Post not found for word:systemic risks. A general-purpose AI model that meets the applicable threshold for high-impact capabilities should be presumed to be a general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk. The Error! Post not found for word:provider should notify the Error! Post not found for word:ai office at the latest two weeks after the requirements are met or it becomes known that a general-purpose AI model will meet the requirements that lead to the presumption. This is especially relevant in relation to the threshold of floating point operations because training of general-purpose AI models takes considerable planning which includes the upfront allocation of compute resources and, therefore, Error! Post not found for word:providers of general-purpose AI models are able to know if their model would meet the threshold before the training is completed. In the context of that notification, the Error! Post not found for word:provider should be able to demonstrate that, because of its specific characteristics, a general-purpose AI model exceptionally does not present Error! Post not found for word:systemic risks, and that it thus should not be classified as a general-purpose AI model with Error! Post not found for word:systemic risks. That information is valuable for the Error! Post not found for word:ai office to anticipate the placing on the market of general-purpose AI models with Error! Post not found for word:systemic risks and the Error! Post not found for word:providers can start to engage with the Error! Post not found for word:ai office early on. That information is especially important with regard to general-purpose AI models that are planned to be released as open-source, given that, after the open-source model release, necessary measures to ensure compliance with the obligations under this Regulation may be more difficult to implement.
(113) If the Commission becomes aware of the fact that a general-purpose AI model meets the requirements to classify as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk, which previously had either not been known or of which the relevant Error! Post not found for word:provider has failed to notify the Commission, the Commission should be empowered to designate it so. A system of qualified alerts should ensure that the Error! Post not found for word:ai office is made aware by the scientific panel of general-purpose AI models that should possibly be classified as general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk, in addition to the monitoring activities of the Error! Post not found for word:ai office.
(114) The Error! Post not found for word:providers of general-purpose AI models presenting Error! Post not found for word:systemic risks should be Error! Post not found for word:subject, in addition to the obligations provided for Error! Post not found for word:providers of general-purpose AI models, to obligations aimed at identifying and mitigating those risks and ensuring an adequate level of Error! Post not found for word:cybersecurity protection, regardless of whether it is provided as a standalone model or embedded in an Error! Post not found for word:ai system or a product. To achieve those objectives, this Regulation should require Error! Post not found for word:providers to perform the necessary model evaluations, in particular prior to its first placing on the market, including conducting and documenting adversarial testing of models, also, as appropriate, through internal or independent external testing. In addition, Error! Post not found for word:providers of general-purpose AI models with Error! Post not found for word:systemic risks should continuously assess and mitigate Error! Post not found for word:systemic risks, including for example by putting in place Error! Post not found for word:risk-management policies, such as Error! Post not found for word:accountability and governance processes, implementing post-market monitoring, taking appropriate measures along the entire model’s lifecycle and cooperating with relevant actors along the AI value chain.
(115) Error! Post not found for word:providers of general-purpose AI models with Error! Post not found for word:systemic risks should assess and mitigate possible Error! Post not found for word:systemic risks. If, despite efforts to identify and prevent risks related to a general-purpose AI model that may present Error! Post not found for word:systemic risks, the development or use of the model causes a Error! Post not found for word:serious Error! Post not found for word:incident, the general-purpose AI model Error! Post not found for word:provider should without undue delay keep track of the Error! Post not found for word:incident and report any relevant information and possible corrective measures to the Commission and national competent authorities. Furthermore, Error! Post not found for word:providers should ensure an adequate level of Error! Post not found for word:cybersecurity protection for the model and its physical infrastructure, if appropriate, along the entire model lifecycle. Error! Post not found for word:cybersecurity protection related to Error! Post not found for word:systemic risks associated with malicious use or attacks should duly consider accidental model leakage, unauthorised releases, circumvention of safety measures, and defence against cyberattacks, unauthorised access or model theft. That protection could be facilitated by securing model weights, algorithms, servers, and Error! Post not found for word:data sets, such as through operational security measures for information security, specific Error! Post not found for word:cybersecurity policies, adequate technical and established solutions, and cyber and physical access controls, appropriate to the relevant circumstances and the risks involved.
(116) The Error! Post not found for word:ai office should encourage and facilitate the drawing up, review and adaptation of codes of practice, taking into account international approaches. All Error! Post not found for word:providers of general-purpose AI models could be invited to participate. To ensure that the codes of practice reflect the state of the art and duly take into account a diverse set of perspectives, the Error! Post not found for word:ai office should collaborate with relevant national competent authorities, and could, where appropriate, consult with civil society organisations and other relevant stakeholders and experts, including the Scientific Panel, for the drawing up of such codes. Codes of practice should cover obligations for Error! Post not found for word:providers of general-purpose AI models and of general-purpose AI models presenting Error! Post not found for word:systemic risks. In addition, as regards Error! Post not found for word:systemic risks, codes of practice should help to establish a Error! Post not found for word:risk taxonomy of the type and nature of the Error! Post not found for word:systemic risks at Union level, including their sources. Codes of practice should also be focused on specific Error! Post not found for word:risk assessment and mitigation measures.
(117) The codes of practice should represent a central tool for the proper compliance with the obligations provided for under this Regulation for Error! Post not found for word:providers of general-purpose AI models. Error! Post not found for word:providers should be able to rely on codes of practice to demonstrate compliance with the obligations. By means of implementing acts, the Commission may decide to approve a code of practice and give it a general validity within the Union, or, alternatively, to provide common rules for the implementation of the relevant obligations, if, by the time this Regulation becomes applicable, a code of practice cannot be finalised or is not deemed adequate by the Error! Post not found for word:ai office. Once a harmonised standard is published and assessed as suitable to cover the relevant obligations by the Error! Post not found for word:ai office, compliance with a European harmonised standard should grant Error! Post not found for word:providers the presumption of conformity. Error! Post not found for word:providers of general-purpose AI models should furthermore be able to demonstrate compliance using alternative adequate means, if codes of practice or harmonised standards are not available, or they choose not to rely on those.
(118) This Regulation regulates Error! Post not found for word:ai systems and AI models by imposing certain requirements and obligations for relevant market actors that are placing them on the market, putting into service or use in the Union, thereby complementing obligations for Error! Post not found for word:providers of intermediary services that embed such systems or models into their services regulated by Regulation (EU) 2022/2065. To the extent that such systems or models are embedded into designated very large online platforms or very large online search engines, they are Error! Post not found for word:subject to the Error! Post not found for word:risk-management framework provided for in Regulation (EU) 2022/2065. Consequently, the corresponding obligations of this Regulation should be presumed to be fulfilled, unless significant Error! Post not found for word:systemic risks not covered by Regulation (EU) 2022/2065 emerge and are identified in such models. Within this framework, Error! Post not found for word:providers of very large online platforms and very large online search engines are obliged to assess potential Error! Post not found for word:systemic risks stemming from the design, functioning and use of their services, including how the design of algorithmic systems used in the service may contribute to such risks, as well as Error! Post not found for word:systemic risks stemming from potential misuses. Those Error! Post not found for word:providers are also obliged to take appropriate mitigating measures in observance of fundamental rights.
(119) Considering the quick pace of innovation and the technological evolution of Error! Post not found for word:digital services in scope of different instruments of Union law in particular having in mind the usage and the perception of their recipients, the Error! Post not found for word:ai systems Error! Post not found for word:subject to this Regulation may be provided as intermediary services or parts thereof within the meaning of Regulation (EU) 2022/2065, which should be interpreted in a technology-neutral manner. For example, Error! Post not found for word:ai systems may be used to provide online search engines, in particular, to the extent that an Error! Post not found for word:ai system such as an online chatbot performs searches of, in principle, all websites, then incorporates the results into its existing knowledge and uses the updated knowledge to generate a single output that combines different sources of information.
(120) Furthermore, obligations placed on Error! Post not found for word:providers and Error! Post not found for word:deployers of certain Error! Post not found for word:ai systems in this Regulation to enable the detection and disclosure that the outputs of those systems are artificially generated or manipulated are particularly relevant to facilitate the effective implementation of Regulation (EU) 2022/2065. This applies in particular as regards the obligations of Error! Post not found for word:providers of very large online platforms or very large online search engines to identify and mitigate Error! Post not found for word:systemic risks that may arise from the dissemination of content that has been artificially generated or manipulated, in particular Error! Post not found for word:risk of the actual or foreseeable negative effects on democratic processes, civic discourse and electoral processes, including through disinformation.
(121) Standardisation should play a key role to provide technical solutions to Error! Post not found for word:providers to ensure compliance with this Regulation, in line with the state of the art, to promote innovation as well as competitiveness and growth in the single market. Compliance with harmonised standards as defined in Article 2, point (1)(c), of Regulation (EU) No 1025/2012 of the European Parliament and of the Council(48), which are normally expected to reflect the state of the art, should be a means for Error! Post not found for word:providers to demonstrate conformity with the requirements of this Regulation. A balanced representation of interests involving all relevant stakeholders in the development of standards, in particular SMEs, Error! Post not found for word:consumer organisations and environmental and social stakeholders in accordance with Articles 5 and 6 of Regulation (EU) No 1025/2012 should therefore be encouraged. In order to facilitate compliance, the standardisation requests should be issued by the Commission without undue delay. When preparing the standardisation request, the Commission should consult the advisory forum and the Board in order to collect relevant expertise. However, in the absence of relevant references to harmonised standards, the Commission should be able to establish, via implementing acts, and after consultation of the advisory forum, common specifications for certain requirements under this Regulation.
The common specification should be an exceptional fall back solution to facilitate the Error! Post not found for word:provider’s obligation to comply with the requirements of this Regulation, when the standardisation request has not been accepted by any of the European standardisation organisations, or when the relevant harmonised standards insufficiently address fundamental rights concerns, or when the harmonised standards do not comply with the request, or when there are delays in the adoption of an appropriate harmonised standard. Where such a delay in the adoption of a harmonised standard is due to the technical complexity of that Error! Post not found for word:standard, this should be considered by the Commission before contemplating the establishment of common specifications. When developing common specifications, the Commission is encouraged to cooperate with international partners and international standardisation bodies.
(122) It is appropriate that, without prejudice to the use of harmonised standards and common specifications, Error! Post not found for word:providers of a high-Error! Post not found for word:risk Error! Post not found for word:ai system that has been trained and tested on Error! Post not found for word:data reflecting the specific geographical, behavioural, contextual or functional setting within which the Error! Post not found for word:ai system is intended to be used, should be presumed to comply with the relevant measure provided for under the requirement on Error! Post not found for word:data governance set out in this Regulation. Without prejudice to the requirements related to robustness and Error! Post not found for word:accuracy set out in this Regulation, in accordance with Article 54(3) of Regulation (EU) 2019/881, high-Error! Post not found for word:risk Error! Post not found for word:ai systems that have been certified or for which a statement of conformity has been issued under a Error! Post not found for word:cybersecurity scheme pursuant to that Regulation and the references of which have been published in the Official Journal of the European Union should be presumed to comply with the Error! Post not found for word:cybersecurity requirement of this Regulation in so far as the Error! Post not found for word:cybersecurity certificate or statement of conformity or parts thereof cover the Error! Post not found for word:cybersecurity requirement of this Regulation This remains without prejudice to the voluntary nature of that Error! Post not found for word:cybersecurity scheme.
(123) In order to ensure a high level of trustworthiness of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, those systems should be Error! Post not found for word:subject to a conformity assessment prior to their placing on the market or putting into service.
(124) It is appropriate that, in order to minimise the burden on Error! Post not found for word:operators and avoid any possible duplication, for high-Error! Post not found for word:risk Error! Post not found for word:ai systems related to products which are covered by existing Union harmonisation legislation based on the New Legislative Framework, the compliance of those Error! Post not found for word:ai systems with the requirements of this Regulation should be assessed as part of the conformity assessment already provided for in that law. The applicability of the requirements of this Regulation should thus not affect the specific logic, methodology or general structure of conformity assessment under the relevant Union harmonisation legislation.
(125) Given the complexity of high-Error! Post not found for word:risk Error! Post not found for word:ai systems and the risks that are associated with them, it is important to develop an adequate conformity assessment procedure for high-Error! Post not found for word:risk Error! Post not found for word:ai systems involving notified bodies, so-called Error! Post not found for word:third party conformity assessment. However, given the current experience of professional pre-market certifiers in the field of product safety and the different nature of risks involved, it is appropriate to limit, at least in an initial phase of application of this Regulation, the scope of application of third-party conformity assessment for high-Error! Post not found for word:risk Error! Post not found for word:ai systems other than those related to products. Therefore, the conformity assessment of such systems should be carried out as a general rule by the Error! Post not found for word:provider under its own responsibility, with the only exception of Error! Post not found for word:ai systems intended to be used for biometrics.
(126) In order to carry out third-party conformity assessments when so required, notified bodies should be notified under this Regulation by the national competent authorities, provided that they comply with a set of requirements, in particular on independence, competence, absence of conflicts of interests and suitable Error! Post not found for word:cybersecurity requirements. Notification of those bodies should be sent by national competent authorities to the Commission and the other Member States by means of the electronic notification tool developed and managed by the Commission pursuant to Article R23 of Annex I to Decision No 768/2008/EC.
(127) In line with Union commitments under the World Trade Organization Agreement on Technical Barriers to Trade, it is adequate to facilitate the mutual recognition of conformity assessment results produced by competent conformity assessment bodies, independent of the territory in which they are established, provided that those conformity assessment bodies established under the law of a third country meet the applicable requirements of this Regulation and the Union has concluded an agreement to that extent. In this context, the Commission should actively explore possible international instruments for that purpose and in particular pursue the conclusion of mutual recognition agreements with third countries.
(128) In line with the commonly established notion of substantial modification for products regulated by Union harmonisation legislation, it is appropriate that whenever a change occurs which may affect the compliance of a high-Error! Post not found for word:risk Error! Post not found for word:ai system with this Regulation (e.g. change of Error! Post not found for word:operating system or Error! Post not found for word:software architecture), or when the Error! Post not found for word:intended purpose of the system changes, that Error! Post not found for word:ai system should be considered to be a new Error! Post not found for word:ai system which should undergo a new conformity assessment. However, changes occurring to the algorithm and the performance of Error! Post not found for word:ai systems which continue to ‘learn’ after being placed on the market or put into service, namely automatically adapting how functions are carried out, should not constitute a substantial modification, provided that those changes have been pre-determined by the Error! Post not found for word:provider and assessed at the moment of the conformity assessment.
(129) High-Error! Post not found for word:risk Error! Post not found for word:ai systems should bear the Error! Post not found for word:ce marking to indicate their conformity with this Regulation so that they can move freely within the internal market. For high-Error! Post not found for word:risk Error! Post not found for word:ai systems embedded in a product, a physical Error! Post not found for word:ce marking should be affixed, and may be complemented by a digital Error! Post not found for word:ce marking. For high-Error! Post not found for word:risk Error! Post not found for word:ai systems only provided digitally, a digital Error! Post not found for word:ce marking should be used. Member States should not create unjustified obstacles to the placing on the market or the putting into service of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that comply with the requirements laid down in this Regulation and bear the Error! Post not found for word:ce marking.
(130) Under certain conditions, rapid Error! Post not found for word:availability of innovative technologies may be crucial for health and safety of persons, the protection of the environment and climate change and for society as a whole. It is thus appropriate that under exceptional reasons of public security or protection of life and health of natural persons, environmental protection and the protection of key industrial and infrastructural assets, market surveillance authorities could authorise the placing on the market or the putting into service of Error! Post not found for word:ai systems which have not undergone a conformity assessment. In duly justified situations as provided for in this Regulation, Error! Post not found for word:law enforcement authorities or civil protection authorities may put a specific high-Error! Post not found for word:risk Error! Post not found for word:ai system into service without the authorisation of the market surveillance authority, provided that such authorisation is requested during or after the use without undue delay.
(131) In order to facilitate the work of the Commission and the Member States in the AI field as well as to increase the transparency towards the public, Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems other than those related to products falling within the scope of relevant existing Union harmonisation legislation, as well as Error! Post not found for word:providers who consider that an Error! Post not found for word:ai system listed in the high-Error! Post not found for word:risk use cases in an annex to this Regulation is not high-Error! Post not found for word:risk on the basis of a derogation, should be required to register themselves and information about their Error! Post not found for word:ai system in an EU database, to be established and managed by the Commission. Before using such an Error! Post not found for word:ai system listed in the high-Error! Post not found for word:risk use cases in an annex to this Regulation, Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are public authorities, agencies or bodies, should register themselves in such database and select the system that they envisage to use.
Other Error! Post not found for word:deployers should be entitled to do so voluntarily. This section of the EU database should be publicly accessible, free of charge, the information should be easily navigable, understandable and machine-readable. The EU database should also be Error! Post not found for word:user-friendly, for example by providing search functionalities, including through keywords, allowing the general public to find relevant information to be submitted upon the registration of high-Error! Post not found for word:risk Error! Post not found for word:ai systems and on the use case of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, set out in an annex to this Regulation, to which the high-Error! Post not found for word:risk Error! Post not found for word:ai systems correspond. Any substantial modification of high-Error! Post not found for word:risk Error! Post not found for word:ai systems should also be registered in the EU database. For high-Error! Post not found for word:risk Error! Post not found for word:ai systems in the area of Error! Post not found for word:law enforcement, migration, asylum and border control management, the registration obligations should be fulfilled in a secure non-public section of the EU database. Access to the secure non-public section should be strictly limited to the Commission as well as to market surveillance authorities with regard to their national section of that database. High-Error! Post not found for word:risk Error! Post not found for word:ai systems in the area of critical infrastructure should only be registered at national level. The Commission should be the Error! Post not found for word:controller of the EU database, in accordance with Regulation (EU) 2018/1725. In order to ensure the full functionality of the EU database, when deployed, the procedure for setting the database should include the development of functional specifications by the Commission and an independent audit report. The Commission should take into account Error! Post not found for word:cybersecurity risks when carrying out its tasks as Error! Post not found for word:data Error! Post not found for word:controller on the EU database. In order to maximise the Error! Post not found for word:availability and use of the EU database by the public, the EU database, including the information made available through it, should comply with requirements under the Directive (EU) 2019/882.
(132) Certain Error! Post not found for word:ai systems intended to interact with natural persons or to generate content may pose specific risks of impersonation or deception irrespective of whether they qualify as high-Error! Post not found for word:risk or not. In certain circumstances, the use of these systems should therefore be Error! Post not found for word:subject to specific transparency obligations without prejudice to the requirements and obligations for high-Error! Post not found for word:risk Error! Post not found for word:ai systems and Error! Post not found for word:subject to targeted exceptions to take into account the special need of Error! Post not found for word:law enforcement. In particular, natural persons should be notified that they are interacting with an Error! Post not found for word:ai system, unless this is obvious from the point of view of a natural person who is reasonably well-informed, observant and circumspect taking into account the circumstances and the context of use. When implementing that obligation, the characteristics of natural persons belonging to vulnerable groups due to their age or disability should be taken into account to the extent the Error! Post not found for word:ai system is intended to interact with those groups as well. Moreover, natural persons should be notified when they are exposed to Error! Post not found for word:ai systems that, by Error! Post not found for word:processing their Error! Post not found for word:biometric Error! Post not found for word:data, can identify or infer the emotions or intentions of those persons or assign them to specific categories. Such specific categories can relate to aspects such as sex, age, hair colour, eye colour, tattoos, personal traits, ethnic origin, personal preferences and interests. Such information and notifications should be provided in accessible formats for persons with disabilities.
(133) A variety of Error! Post not found for word:ai systems can generate large quantities of synthetic content that becomes increasingly hard for humans to distinguish from human-generated and authentic content. The wide Error! Post not found for word:availability and increasing capabilities of those systems have a significant impact on the integrity and trust in the information ecosystem, raising new risks of misinformation and manipulation at scale, fraud, impersonation and Error! Post not found for word:consumer deception. In light of those impacts, the fast technological pace and the need for new methods and techniques to trace origin of information, it is appropriate to require Error! Post not found for word:providers of those systems to embed technical solutions that enable marking in a machine readable format and detection that the output has been generated or manipulated by an Error! Post not found for word:ai system and not a human. Such techniques and methods should be sufficiently reliable, interoperable, effective and robust as far as this is technically feasible, taking into account available techniques or a combination of such techniques, such as watermarks, Error! Post not found for word:metadata identifications, cryptographic methods for proving provenance and authenticity of content, logging methods, fingerprints or other techniques, as may be appropriate. When implementing this obligation, Error! Post not found for word:providers should also take into account the specificities and the limitations of the different types of content and the relevant technological and market developments in the field, as reflected in the generally acknowledged state of the art. Such techniques and methods can be implemented at the level of the Error! Post not found for word:ai system or at the level of the AI model, including general-purpose AI models generating content, thereby facilitating fulfilment of this obligation by the downstream provider of the Error! Post not found for word:ai system. To remain proportionate, it is appropriate to envisage that this marking obligation should not cover Error! Post not found for word:ai systems performing primarily an assistive function for Error! Post not found for word:standard editing or Error! Post not found for word:ai systems not substantially altering the Error! Post not found for word:input data provided by the Error! Post not found for word:deployer or the semantics thereof.
(134) Further to the technical solutions employed by the Error! Post not found for word:providers of the Error! Post not found for word:ai system, Error! Post not found for word:deployers, who use an Error! Post not found for word:ai system to generate or manipulate image, audio or video content that appreciably resembles existing persons, objects, places, entities or events and would falsely appear to a person to be authentic or truthful (deep fakes), should also clearly and distinguishably disclose that the content has been artificially created or manipulated by labelling the AI output accordingly and disclosing its artificial origin. Compliance with this transparency obligation should not be interpreted as indicating that the use of the Error! Post not found for word:ai system or its output impedes the right to freedom of expression and the right to freedom of the arts and sciences guaranteed in the Charter, in particular where the content is part of an evidently creative, satirical, artistic, fictional or analogous work or programme, Error! Post not found for word:subject to appropriate safeguards for the rights and freedoms of third parties. In those cases, the transparency obligation for deep fakes set out in this Regulation is limited to disclosure of the existence of such generated or manipulated content in an appropriate manner that does not hamper the display or enjoyment of the work, including its normal exploitation and use, while maintaining the utility and quality of the work. In addition, it is also appropriate to envisage a similar disclosure obligation in relation to AI-generated or manipulated text to the extent it is published with the purpose of informing the public on matters of public interest unless the AI-generated content has undergone a process of human review or editorial control and a natural or legal person holds editorial responsibility for the publication of the content.
(135) Without prejudice to the mandatory nature and full applicability of the transparency obligations, the Commission may also encourage and facilitate the drawing up of codes of practice at Union level to facilitate the effective implementation of the obligations regarding the detection and labelling of artificially generated or manipulated content, including to support practical arrangements for making, as appropriate, the detection mechanisms accessible and facilitating cooperation with other actors along the value chain, disseminating content or checking its authenticity and provenance to enable the public to effectively distinguish AI-generated content.
(136) The obligations placed on Error! Post not found for word:providers and Error! Post not found for word:deployers of certain Error! Post not found for word:ai systems in this Regulation to enable the detection and disclosure that the outputs of those systems are artificially generated or manipulated are particularly relevant to facilitate the effective implementation of Regulation (EU) 2022/2065. This applies in particular as regards the obligations of Error! Post not found for word:providers of very large online platforms or very large online search engines to identify and mitigate Error! Post not found for word:systemic risks that may arise from the dissemination of content that has been artificially generated or manipulated, in particular the Error! Post not found for word:risk of the actual or foreseeable negative effects on democratic processes, civic discourse and electoral processes, including through disinformation. The requirement to label content generated by Error! Post not found for word:ai systems under this Regulation is without prejudice to the obligation in Article 16(6) of Regulation (EU) 2022/2065 for Error! Post not found for word:providers of hosting services to process notices on illegal content received pursuant to Article 16(1) of that Regulation and should not influence the assessment and the decision on the illegality of the specific content. That assessment should be performed solely with reference to the rules governing the legality of the content.
(137) Compliance with the transparency obligations for the Error! Post not found for word:ai systems covered by this Regulation should not be interpreted as indicating that the use of the Error! Post not found for word:ai system or its output is lawful under this Regulation or other Union and Member State law and should be without prejudice to other transparency obligations for Error! Post not found for word:deployers of Error! Post not found for word:ai systems laid down in Union or national law.
(138) AI is a rapidly developing family of technologies that requires regulatory oversight and a safe and controlled space for experimentation, while ensuring responsible innovation and integration of appropriate safeguards and Error! Post not found for word:risk mitigation measures. To ensure a legal framework that promotes innovation, is future-proof and resilient to disruption, Member States should ensure that their national competent authorities establish at least one AI regulatory sandbox at national level to facilitate the development and testing of innovative Error! Post not found for word:ai systems under strict regulatory oversight before these systems are placed on the market or otherwise put into service. Member States could also fulfil this obligation through participating in already existing regulatory sandboxes or establishing jointly a sandbox with one or more Member States’ competent authorities, insofar as this participation provides equivalent level of national coverage for the participating Member States. AI regulatory sandboxes could be established in physical, digital or hybrid form and may accommodate physical as well as digital products. Establishing authorities should also ensure that the AI regulatory sandboxes have the adequate resources for their functioning, including financial and human resources.
(139) The objectives of the AI regulatory sandboxes should be to foster AI innovation by establishing a controlled experimentation and testing environment in the development and pre-marketing phase with a view to ensuring compliance of the innovative Error! Post not found for word:ai systems with this Regulation and other relevant Union and national law. Moreover, the AI regulatory sandboxes should aim to enhance legal certainty for innovators and the competent authorities’ oversight and understanding of the opportunities, emerging risks and the impacts of AI use, to facilitate regulatory learning for authorities and Error! Post not found for word:undertakings, including with a view to future adaptions of the legal framework, to support cooperation and the sharing of best practices with the authorities involved in the AI regulatory sandbox, and to accelerate access to markets, including by removing barriers for SMEs, including start-ups. AI regulatory sandboxes should be widely available throughout the Union, and particular attention should be given to their accessibility for SMEs, including start-ups. The participation in the AI regulatory sandbox should focus on issues that raise legal uncertainty for Error! Post not found for word:providers and prospective Error! Post not found for word:providers to innovate, experiment with AI in the Union and contribute to evidence-based regulatory learning. The supervision of the Error! Post not found for word:ai systems in the AI regulatory sandbox should therefore cover their development, training, testing and validation before the systems are placed on the market or put into service, as well as the notion and occurrence of substantial modification that may require a new conformity assessment procedure. Any significant risks identified during the development and testing of such Error! Post not found for word:ai systems should result in adequate mitigation and, failing that, in the suspension of the development and testing process.
Where appropriate, national competent authorities establishing AI regulatory sandboxes should cooperate with other relevant authorities, including those supervising the protection of fundamental rights,, and could allow for the involvement of other actors within the AI ecosystem such as national or European standardisation organisations, notified bodies, testing and experimentation facilities, research and experimentation labs, European Digital Innovation Hubs and relevant stakeholder and civil society organisations. To ensure uniform implementation across the Union and economies of scale, it is appropriate to establish common rules for the AI regulatory sandboxes’ implementation and a framework for cooperation between the relevant authorities involved in the supervision of the sandboxes. AI regulatory sandboxes established under this Regulation should be without prejudice to other law allowing for the establishment of other sandboxes aiming to ensure compliance with law other than this Regulation. Where appropriate, relevant competent authorities in charge of those other regulatory sandboxes should consider the benefits of using those sandboxes also for the purpose of ensuring compliance of Error! Post not found for word:ai systems with this Regulation. Upon agreement between the national competent authorities and the participants in the AI regulatory sandbox, testing in real world conditions may also be operated and supervised in the framework of the AI regulatory sandbox.
(140) This Regulation should provide the legal basis for the Error! Post not found for word:providers and prospective Error! Post not found for word:providers in the AI regulatory sandbox to use Error! Post not found for word:personal Error! Post not found for word:data collected for other purposes for developing certain Error! Post not found for word:ai systems in the public interest within the AI regulatory sandbox, only under specified conditions, in accordance with Article 6(4) and Article 9(2), point (g), of Regulation (EU) 2016/679, and Articles 5, 6 and 10 of Regulation (EU) 2018/1725, and without prejudice to Article 4(2) and Article 10 of Directive (EU) 2016/680. All other obligations of Error! Post not found for word:data Error! Post not found for word:controllers and rights of Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects under Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680 remain applicable. In particular, this Regulation should not provide a legal basis in the meaning of Article 22(2), point (b) of Regulation (EU) 2016/679 and Article 24(2), point (b) of Regulation (EU) 2018/1725. Error! Post not found for word:providers and prospective Error! Post not found for word:providers in the AI regulatory sandbox should ensure appropriate safeguards and cooperate with the competent authorities, including by following their guidance and acting expeditiously and in good faith to adequately mitigate any identified – significant risks to safety, health, and fundamental rights that may arise during the development, testing and experimentation in that sandbox.
(141) In order to accelerate the process of development and the placing on the market of the high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in an annex to this Regulation, it is important that Error! Post not found for word:providers or prospective Error! Post not found for word:providers of such systems may also benefit from a specific regime for testing those systems in real world conditions, without participating in an AI regulatory sandbox. However, in such cases, taking into account the possible consequences of such testing on individuals, it should be ensured that appropriate and sufficient guarantees and conditions are introduced by this Regulation for Error! Post not found for word:providers or prospective Error! Post not found for word:providers. Such guarantees should include, inter alia, requesting Error! Post not found for word:informed Error! Post not found for word:consent of natural persons to participate in testing in real world conditions, with the exception of Error! Post not found for word:law enforcement where the seeking of Error! Post not found for word:informed Error! Post not found for word:consent would prevent the Error! Post not found for word:ai system from being tested. Error! Post not found for word:consent of Error! Post not found for word:subjects to participate in such testing under this Regulation is distinct from and without prejudice, to Error! Post not found for word:consent of Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects for the Error! Post not found for word:processing of their Error! Post not found for word:personal Error! Post not found for word:data under the relevant Error! Post not found for word:data protection law.
It is also important to minimise the risks and enable oversight by competent authorities and therefore require prospective Error! Post not found for word:providers to have a real-world testing plan submitted to competent market surveillance authority, register the testing in dedicated sections in the EU database Error! Post not found for word:subject to some limited exceptions, set limitations on the period for which the testing can be done and require additional safeguards for persons belonging to certain vulnerable groups, as well as a written agreement defining the roles and responsibilities of prospective Error! Post not found for word:providers and Error! Post not found for word:deployers and effective oversight by competent personnel involved in the real world testing. Furthermore, it is appropriate to envisage additional safeguards to ensure that the predictions, recommendations or decisions of the Error! Post not found for word:ai system can be effectively reversed and disregarded and that Error! Post not found for word:personal Error! Post not found for word:data is protected and is deleted when the Error! Post not found for word:subjects have withdrawn their Error! Post not found for word:consent to participate in the testing without prejudice to their rights as Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects under the Union Error! Post not found for word:data protection law. As regards transfer of Error! Post not found for word:data, it is also appropriate to envisage that Error! Post not found for word:data collected and processed for the purpose of testing in real-world conditions should be transferred to third countries only where appropriate and applicable safeguards under Union law are implemented, in particular in accordance with bases for transfer of Error! Post not found for word:personal Error! Post not found for word:data under Union law on Error! Post not found for word:data protection, while for Error! Post not found for word:non\-personal Error! Post not found for word:data appropriate safeguards are put in place in accordance with Union law, such as Regulations (EU) 2022/868(50) and (EU) 2023/2854(51)of the European Parliament and of the Council.
(142) To ensure that AI leads to socially and environmentally beneficial outcomes, Member States are encouraged to support and promote research and development of AI solutions in support of socially and environmentally beneficial outcomes, such as AI-based solutions to increase accessibility for persons with disabilities, tackle socio-economic inequalities, or meet environmental targets, by allocating sufficient resources, including public and Union funding, and, where appropriate and provided that the eligibility and selection criteria are fulfilled, considering in particular projects which pursue such objectives. Such projects should be based on the principle of interdisciplinary cooperation between AI developers, experts on inequality and non-discrimination, accessibility, Error! Post not found for word:consumer, environmental, and digital rights, as well as academics.
(143) In order to promote and protect innovation, it is important that the interests of SMEs, including start-ups, that are Error! Post not found for word:providers or Error! Post not found for word:deployers of Error! Post not found for word:ai systems are taken into particular account. To that end, Member States should develop initiatives, which are targeted at those Error! Post not found for word:operators, including on, awareness raising and information communication. Member States should provide SMEs, including start-ups, that have a registered office or a branch in the Union, with priority access to the AI regulatory sandboxes provided that they fulfil the eligibility conditions and selection criteria and without precluding other Error! Post not found for word:providers and prospective Error! Post not found for word:providers to access the sandboxes provided the same conditions and criteria are fulfilled. Member States should utilise existing channels and where appropriate, establish new dedicated channels for communication with SMEs, including start-ups, Error! Post not found for word:deployers other innovators and, as appropriate, local public authorities, to support SMEs throughout their development path by providing guidance and responding to queries about the implementation of this Regulation. Where appropriate, these channels should work together to create synergies and ensure homogeneity in their guidance to SMEs, including start-ups, and Error! Post not found for word:deployers. Additionally, Member States should facilitate the participation of SMEs and other relevant stakeholders in the standardisation development processes. Moreover, the specific interests and needs of Error! Post not found for word:providers that are SMEs, including start-ups, should be taken into account when notified bodies set conformity assessment fees. The Commission should regularly assess the certification and compliance costs for SMEs, including start-ups, through transparent consultations and should work with Member States to lower such costs.
For example, translation costs related to mandatory documentation and communication with authorities may constitute a significant cost for Error! Post not found for word:providers and other Error! Post not found for word:operators, in particular those of a smaller scale. Member States should possibly ensure that one of the languages determined and accepted by them for relevant Error! Post not found for word:providers’ documentation and for communication with Error! Post not found for word:operators is one which is broadly understood by the largest possible number of cross-border Error! Post not found for word:deployers. In order to address the specific needs of SMEs, including start-ups, the Commission should provide standardised templates for the areas covered by this Regulation upon request of the Board. Additionally, the Commission should complement Member States’ efforts by providing a single information platform with easy-to-use information with regards to this Regulation for all Error! Post not found for word:providers and Error! Post not found for word:deployers, by organising appropriate communication campaigns to raise awareness about the obligations arising from this Regulation, and by evaluating and promoting the convergence of best practices in public procurement procedures in relation to Error! Post not found for word:ai systems. Medium-sized enterprises which until recently qualified as small enterprises within the meaning of the Annex to Commission Recommendation 2003/361/EC(52) should have access to those support measures, as those new medium-sized enterprises may sometimes lack the legal resources and training necessary to ensure proper understanding of, and compliance with, this Regulation.
(144) In order to promote and protect innovation, the AI-on-demand platform, all relevant Union funding programmes and projects, such as Digital Europe Programme, Horizon Europe, implemented by the Commission and the Member States at Union or national level should, as appropriate, contribute to the achievement of the objectives of this Regulation.
(145) In order to minimise the risks to implementation resulting from lack of knowledge and expertise in the market as well as to facilitate compliance of Error! Post not found for word:providers, in particular SMEs, including start-ups, and notified bodies with their obligations under this Regulation, the AI-on-demand platform, the European Digital Innovation Hubs and the testing and experimentation facilities established by the Commission and the Member States at Union or national level should contribute to the implementation of this Regulation. Within their respective mission and fields of competence, the AI-on-demand platform, the European Digital Innovation Hubs and the testing and experimentation Facilities are able to provide in particular technical and scientific support to Error! Post not found for word:providers and notified bodies.
(146) Moreover, in light of the very small size of some Error! Post not found for word:operators and in order to ensure proportionality regarding costs of innovation, it is appropriate to allow microenterprises to fulfil one of the most costly obligations, namely to establish a quality management system, in a simplified manner which would reduce the administrative burden and the costs for those enterprises without affecting the level of protection and the need for compliance with the requirements for high-Error! Post not found for word:risk Error! Post not found for word:ai systems. The Commission should develop guidelines to specify the elements of the quality management system to be fulfilled in this simplified manner by microenterprises.
(147) It is appropriate that the Commission facilitates, to the extent possible, access to testing and experimentation facilities to bodies, groups or laboratories established or accredited pursuant to any relevant Union harmonisation legislation and which fulfil tasks in the context of conformity assessment of products or devices covered by that Union harmonisation legislation. This is, in particular, the case as regards expert panels, expert laboratories and reference laboratories in the field of medical devices pursuant to Regulations (EU) 2017/745 and (EU) 2017/746.
(148) This Regulation should establish a governance framework that both allows to coordinate and support the application of this Regulation at national level, as well as build capabilities at Union level and integrate stakeholders in the field of AI. The effective implementation and enforcement of this Regulation require a governance framework that allows to coordinate and build up central expertise at Union level. The Error! Post not found for word:ai office was established by Commission Decision(53) and has as its mission to develop Union expertise and capabilities in the field of AI and to contribute to the implementation of Union law on AI. Member States should facilitate the tasks of the Error! Post not found for word:ai office with a view to support the development of Union expertise and capabilities at Union level and to strengthen the functioning of the digital single market. Furthermore, a Board composed of Error! Post not found for word:representatives of the Member States, a scientific panel to integrate the scientific community and an advisory forum to contribute stakeholder input to the implementation of this Regulation, at Union and national level, should be established. The development of Union expertise and capabilities should also include making use of existing resources and expertise, in particular through synergies with structures built up in the context of the Union level enforcement of other law and synergies with related initiatives at Union level, such as the EuroHPC Joint Error! Post not found for word:undertaking and the AI testing and experimentation facilities under the Digital Europe Programme.
(149) In order to facilitate a smooth, effective and harmonised implementation of this Regulation a Board should be established. The Board should reflect the various interests of the AI eco-system and be composed of Error! Post not found for word:representatives of the Member States. The Board should be responsible for a number of advisory tasks, including issuing opinions, recommendations, advice or contributing to guidance on matters related to the implementation of this Regulation, including on enforcement matters, technical specifications or existing standards regarding the requirements established in this Regulation and providing advice to the Commission and the Member States and their national competent authorities on specific questions related to AI. In order to give some flexibility to Member States in the designation of their Error! Post not found for word:representatives in the Board, such Error! Post not found for word:representatives may be any persons belonging to public entities who should have the relevant competences and powers to facilitate coordination at national level and contribute to the achievement of the Board’s tasks. The Board should establish two standing sub-groups to provide a platform for cooperation and exchange among market surveillance authorities and notifying authorities on issues related, respectively, to market surveillance and notified bodies. The standing subgroup for market surveillance should act as the administrative cooperation group (ADCO) for this Regulation within the meaning of Article 30 of Regulation (EU) 2019/1020. In accordance with Article 33 of that Regulation, the Commission should support the activities of the standing subgroup for market surveillance by Error! Post not found for word:undertaking market evaluations or studies, in particular with a view to identifying aspects of this Regulation requiring specific and urgent coordination among market surveillance authorities. The Board may establish other standing or temporary sub-groups as appropriate for the purpose of examining specific issues. The Board should also cooperate, as appropriate, with relevant Union institutions, bodies, experts groups and networks active in the context of relevant Union law, including in particular those active under relevant Union law on Error! Post not found for word:data, digital products and services.
(150) With a view to ensuring the involvement of stakeholders in the implementation and application of this Regulation, an advisory forum should be established to advise and provide technical expertise to the Board and the Commission. To ensure a varied and balanced stakeholder representation between commercial and non-commercial interest and, within the category of commercial interests, with regards to SMEs and other Error! Post not found for word:undertakings, the advisory forum should comprise inter alia industry, start-ups, SMEs, academia, civil society, including the social partners, as well as the Fundamental Rights Agency, ENISA, the European Committee for Standardization (CEN), the European Committee for Electrotechnical Standardization (CENELEC) and the European Telecommunications Standards Institute (ETSI).
(151) To support the implementation and enforcement of this Regulation, in particular the monitoring activities of the Error! Post not found for word:ai office as regards general-purpose AI models, a scientific panel of independent experts should be established. The independent experts constituting the scientific panel should be selected on the basis of up-to-date scientific or technical expertise in the field of AI and should perform their tasks with impartiality, objectivity and ensure the confidentiality of information and Error! Post not found for word:data obtained in carrying out their tasks and activities. To allow the reinforcement of national capacities necessary for the effective enforcement of this Regulation, Member States should be able to request support from the pool of experts constituting the scientific panel for their enforcement activities.
(152) In order to support adequate enforcement as regards Error! Post not found for word:ai systems and reinforce the capacities of the Member States, Union AI testing support structures should be established and made available to the Member States.
(153) Member States hold a key role in the application and enforcement of this Regulation. In that respect, each Member State should designate at least one notifying authority and at least one market surveillance authority as national competent authorities for the purpose of supervising the application and implementation of this Regulation. Member States may decide to appoint any kind of public entity to perform the tasks of the national competent authorities within the meaning of this Regulation, in accordance with their specific national organisational characteristics and needs. In order to increase organisation efficiency on the side of Member States and to set a single point of contact vis-à-vis the public and other counterparts at Member State and Union levels, each Member State should designate a market surveillance authority to act as a single point of contact.
(154) The national competent authorities should exercise their powers independently, impartially and without bias, so as to safeguard the principles of objectivity of their activities and tasks and to ensure the application and implementation of this Regulation. The members of these authorities should refrain from any action incompatible with their duties and should be Error! Post not found for word:subject to confidentiality rules under this Regulation.
(155) In order to ensure that Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems can take into account the experience on the use of high-Error! Post not found for word:risk Error! Post not found for word:ai systems for improving their systems and the design and development process or can take any possible corrective action in a timely manner, all Error! Post not found for word:providers should have a post-market monitoring system in place. Where relevant, post-market monitoring should include an analysis of the interaction with other Error! Post not found for word:ai systems including other devices and Error! Post not found for word:software. Post-market monitoring should not cover sensitive operational data of Error! Post not found for word:deployers which are Error! Post not found for word:law enforcement authorities. This system is also key to ensure that the possible risks emerging from Error! Post not found for word:ai systems which continue to ‘learn’ after being placed on the market or put into service can be more efficiently and timely addressed. In this context, Error! Post not found for word:providers should also be required to have a system in place to report to the relevant authorities any Error! Post not found for word:serious Error! Post not found for word:incidents resulting from the use of their Error! Post not found for word:ai systems, meaning Error! Post not found for word:incident or malfunctioning leading to death or serious damage to health, serious and irreversible disruption of the management and operation of critical infrastructure, infringements of obligations under Union law intended to protect fundamental rights or serious damage to property or the environment.
(156) In order to ensure an appropriate and effective enforcement of the requirements and obligations set out by this Regulation, which is Union harmonisation legislation, the system of market surveillance and compliance of products established by Regulation (EU) 2019/1020 should apply in its entirety. Market surveillance authorities designated pursuant to this Regulation should have all enforcement powers laid down in this Regulation and in Regulation (EU) 2019/1020 and should exercise their powers and carry out their duties independently, impartially and without bias. Although the majority of Error! Post not found for word:ai systems are not Error! Post not found for word:subject to specific requirements and obligations under this Regulation, market surveillance authorities may take measures in relation to all Error! Post not found for word:ai systems when they present a Error! Post not found for word:risk in accordance with this Regulation. Due to the specific nature of Union institutions, agencies and bodies falling within the scope of this Regulation, it is appropriate to designate the European Error! Post not found for word:data Protection Supervisor as a competent market surveillance authority for them. This should be without prejudice to the designation of national competent authorities by the Member States. Market surveillance activities should not affect the ability of the supervised entities to carry out their tasks independently, when such independence is required by Union law.
(157) This Regulation is without prejudice to the competences, tasks, powers and independence of relevant national public authorities or bodies which supervise the application of Union law protecting fundamental rights, including equality bodies and Error! Post not found for word:data protection authorities. Where necessary for their mandate, those national public authorities or bodies should also have access to any documentation created under this Regulation. A specific safeguard procedure should be set for ensuring adequate and timely enforcement against Error! Post not found for word:ai systems presenting a Error! Post not found for word:risk to health, safety and fundamental rights. The procedure for such Error! Post not found for word:ai systems presenting a Error! Post not found for word:risk should be applied to high-Error! Post not found for word:risk Error! Post not found for word:ai systems presenting a Error! Post not found for word:risk, prohibited systems which have been placed on the market, put into service or used in violation of the prohibited practices laid down in this Regulation and Error! Post not found for word:ai systems which have been made available in violation of the transparency requirements laid down in this Regulation and present a Error! Post not found for word:risk.
(158) Union financial services law includes internal governance and Error! Post not found for word:risk-management rules and requirements which are applicable to regulated financial institutions in the course of provision of those services, including when they make use of Error! Post not found for word:ai systems. In order to ensure coherent application and enforcement of the obligations under this Regulation and relevant rules and requirements of the Union financial services legal acts, the competent authorities for the supervision and enforcement of those legal acts, in particular competent authorities as defined in Regulation (EU) No 575/2013 of the European Parliament and of the Council(54) and Directives 2008/48/EC(55), 2009/138/EC(56), 2013/36/EU(57), 2014/17/EU(58) and (EU) 2016/97(59)of the European Parliament and of the Council, should be designated, within their respective competences, as competent authorities for the purpose of supervising the implementation of this Regulation, including for market surveillance activities, as regards Error! Post not found for word:ai systems provided or used by regulated and supervised financial institutions unless Member States decide to designate another authority to fulfil these market surveillance tasks.
Those competent authorities should have all powers under this Regulation and Regulation (EU) 2019/1020 to enforce the requirements and obligations of this Regulation, including powers to carry our ex post market surveillance activities that can be integrated, as appropriate, into their existing supervisory mechanisms and procedures under the relevant Union financial services law. It is appropriate to envisage that, when acting as market surveillance authorities under this Regulation, the national authorities responsible for the supervision of credit institutions regulated under Directive 2013/36/EU, which are participating in the Single Supervisory Mechanism established by Council Regulation (EU) No 1024/2013(60), should report, without delay, to the European Central Bank any information identified in the course of their market surveillance activities that may be of potential interest for the European Central Bank’s prudential supervisory tasks as specified in that Regulation.
To further enhance the consistency between this Regulation and the rules applicable to credit institutions regulated under Directive 2013/36/EU, it is also appropriate to integrate some of the Error! Post not found for word:providers’ procedural obligations in relation to Error! Post not found for word:risk management, post marketing monitoring and documentation into the existing obligations and procedures under Directive 2013/36/EU. In order to avoid overlaps, limited derogations should also be envisaged in relation to the quality management system of Error! Post not found for word:providers and the monitoring obligation placed on Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems to the extent that these apply to credit institutions regulated by Directive 2013/36/EU. The same regime should apply to insurance and re-insurance Error! Post not found for word:undertakings and insurance holding companies under Directive 2009/138/EC and the insurance intermediaries under Directive (EU) 2016/97 and other types of financial institutions Error! Post not found for word:subject to requirements regarding internal governance, arrangements or processes established pursuant to the relevant Union financial services law to ensure consistency and equal treatment in the financial sector.
(159) Each market surveillance authority for high-Error! Post not found for word:risk Error! Post not found for word:ai systems in the area of biometrics, as listed in an annex to this Regulation insofar as those systems are used for the purposes of Error! Post not found for word:law enforcement, migration, asylum and border control management, or the administration of justice and democratic processes, should have effective investigative and corrective powers, including at least the power to obtain access to all Error! Post not found for word:personal Error! Post not found for word:data that are being processed and to all information necessary for the performance of its tasks. The market surveillance authorities should be able to exercise their powers by acting with complete independence. Any limitations of their access to sensitive operational data under this Regulation should be without prejudice to the powers conferred to them by Directive (EU) 2016/680. No exclusion on disclosing Error! Post not found for word:data to national Error! Post not found for word:data protection authorities under this Regulation should affect the current or future powers of those authorities beyond the scope of this Regulation.
(160) The market surveillance authorities and the Commission should be able to propose joint activities, including joint investigations, to be conducted by market surveillance authorities or market surveillance authorities jointly with the Commission, that have the aim of promoting compliance, identifying non-compliance, raising awareness and providing guidance in relation to this Regulation with respect to specific categories of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are found to present a serious Error! Post not found for word:risk across two or more Member States. Joint activities to promote compliance should be carried out in accordance with Article 9 of Regulation (EU) 2019/1020. The Error! Post not found for word:ai office should provide coordination support for joint investigations.
(161) It is necessary to clarify the responsibilities and competences at Union and national level as regards Error! Post not found for word:ai systems that are built on general-purpose AI models. To avoid overlapping competences, where an Error! Post not found for word:ai system is based on a general-purpose AI model and the model and system are provided by the same Error! Post not found for word:provider, the supervision should take place at Union level through the Error! Post not found for word:ai office, which should have the powers of a market surveillance authority within the meaning of Regulation (EU) 2019/1020 for this purpose. In all other cases, national market surveillance authorities remain responsible for the supervision of Error! Post not found for word:ai systems. However, for general-purpose AI systems that can be used directly by Error! Post not found for word:deployers for at least one purpose that is classified as high-Error! Post not found for word:risk, market surveillance authorities should cooperate with the Error! Post not found for word:ai office to carry out evaluations of compliance and inform the Board and other market surveillance authorities accordingly. Furthermore, market surveillance authorities should be able to request assistance from the Error! Post not found for word:ai office where the market surveillance authority is unable to conclude an investigation on a high-Error! Post not found for word:risk Error! Post not found for word:ai system because of its inability to access certain information related to the general-purpose AI model on which the high-Error! Post not found for word:risk Error! Post not found for word:ai system is built. In such cases, the procedure regarding mutual assistance in cross-border cases in Chapter VI of Regulation (EU) 2019/1020 should apply mutatis mutandis.
(162) To make best use of the centralised Union expertise and synergies at Union level, the powers of supervision and enforcement of the obligations on Error! Post not found for word:providers of general-purpose AI models should be a competence of the Commission. The Error! Post not found for word:ai office should be able to carry out all necessary actions to monitor the effective implementation of this Regulation as regards general-purpose AI models. It should be able to investigate possible infringements of the rules on Error! Post not found for word:providers of general-purpose AI models both on its own initiative, following the results of its monitoring activities, or upon request from market surveillance authorities in line with the conditions set out in this Regulation. To support effective monitoring of the Error! Post not found for word:ai office, it should provide for the possibility that downstream providers lodge complaints about possible infringements of the rules on Error! Post not found for word:providers of general-purpose AI models and systems.
(163) With a view to complemening the governance systems for general-purpose AI models, the scientific panel should support the monitoring activities of the Error! Post not found for word:ai office and may, in certain cases, provide qualified alerts to the Error! Post not found for word:ai office which trigger follow-ups such as investigations. This should be the case where the scientific panel has reason to suspect that a general-purpose AI model poses a concrete and identifiable Error! Post not found for word:risk at Union level. Furthermore, this should be the case where the scientific panel has reason to suspect that a general-purpose AI model meets the criteria that would lead to a classification as general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk. To equip the scientific panel with the information necessary for the performance of those tasks, there should be a mechanism whereby the scientific panel can request the Commission to require documentation or information from a Error! Post not found for word:provider.
(164) The Error! Post not found for word:ai office should be able to take the necessary actions to monitor the effective implementation of and compliance with the obligations for Error! Post not found for word:providers of general-purpose AI models laid down in this Regulation. The Error! Post not found for word:ai office should be able to investigate possible infringements in accordance with the powers provided for in this Regulation, including by requesting documentation and information, by conducting evaluations, as well as by requesting measures from Error! Post not found for word:providers of general-purpose AI models. When conducting evaluations, in order to make use of independent expertise, the Error! Post not found for word:ai office should be able to involve independent experts to carry out the evaluations on its behalf. Compliance with the obligations should be enforceable, inter alia, through requests to take appropriate measures, including Error! Post not found for word:risk mitigation measures in the case of identified Error! Post not found for word:systemic risks as well as restricting the making available on the market, withdrawing or recalling the model. As a safeguard, where needed beyond the procedural rights provided for in this Regulation, Error! Post not found for word:providers of general-purpose AI models should have the procedural rights provided for in Article 18 of Regulation (EU) 2019/1020, which should apply mutatis mutandis, without prejudice to more specific procedural rights provided for by this Regulation.
(165) The development of Error! Post not found for word:ai systems other than high-Error! Post not found for word:risk Error! Post not found for word:ai systems in accordance with the requirements of this Regulation may lead to a larger uptake of ethical and trustworthy AI in the Union. Error! Post not found for word:providers of Error! Post not found for word:ai systems that are not high-Error! Post not found for word:risk should be encouraged to create Error! Post not found for word:codes of conduct, including related governance mechanisms, intended to foster the voluntary application of some or all of the mandatory requirements applicable to high-Error! Post not found for word:risk Error! Post not found for word:ai systems, adapted in light of the Error! Post not found for word:intended purpose of the systems and the lower Error! Post not found for word:risk involved and taking into account the available technical solutions and industry best practices such as model and Error! Post not found for word:data cards. Error! Post not found for word:providers and, as appropriate, Error! Post not found for word:deployers of all Error! Post not found for word:ai systems, high-Error! Post not found for word:risk or not, and AI models should also be encouraged to apply on a voluntary basis additional requirements related, for example, to the elements of the Union’s Ethics Guidelines for Trustworthy AI, environmental sustainability, Error! Post not found for word:ai literacy measures, inclusive and diverse design and development of Error! Post not found for word:ai systems, including attention to vulnerable persons and accessibility to persons with disability, stakeholders’ participation with the involvement, as appropriate, of relevant stakeholders such as business and civil society organisations, academia, research organisations, trade unions and Error! Post not found for word:consumer protection organisations in the design and development of Error! Post not found for word:ai systems, and diversity of the development teams, including gender balance. To ensure that the voluntary Error! Post not found for word:codes of conduct are effective, they should be based on clear objectives and key performance indicators to measure the achievement of those objectives. They should also be developed in an inclusive way, as appropriate, with the involvement of relevant stakeholders such as business and civil society organisations, academia, research organisations, trade unions and Error! Post not found for word:consumer protection organisation. The Commission may develop initiatives, including of a sectoral nature, to facilitate the lowering of technical barriers hindering cross-border exchange of Error! Post not found for word:data for AI development, including on Error! Post not found for word:data access infrastructure, semantic and technical Error! Post not found for word:interoperability of different types of Error! Post not found for word:data.
(166) It is important that Error! Post not found for word:ai systems related to products that are not high-Error! Post not found for word:risk in accordance with this Regulation and thus are not required to comply with the requirements set out for high-Error! Post not found for word:risk Error! Post not found for word:ai systems are nevertheless safe when placed on the market or put into service. To contribute to this objective, Regulation (EU) 2023/988 of the European Parliament and of the Council(61) would apply as a safety net.
(167) In order to ensure trustful and constructive cooperation of competent authorities on Union and national level, all parties involved in the application of this Regulation should respect the confidentiality of information and Error! Post not found for word:data obtained in carrying out their tasks, in accordance with Union or national law. They should carry out their tasks and activities in such a manner as to protect, in particular, intellectual property rights, confidential business information and trade secrets, the effective implementation of this Regulation, public and national security interests, the integrity of criminal and administrative proceedings, and the integrity of classified information.
(168) Compliance with this Regulation should be enforceable by means of the imposition of penalties and other enforcement measures. Member States should take all necessary measures to ensure that the provisions of this Regulation are implemented, including by laying down effective, proportionate and dissuasive penalties for their infringement, and to respect the ne bis in idem principle. In order to strengthen and harmonise administrative penalties for infringement of this Regulation, the upper limits for setting the administrative fines for certain specific infringements should be laid down. When assessing the amount of the fines, Member States should, in each individual case, take into account all relevant circumstances of the specific situation, with due regard in particular to the nature, gravity and duration of the infringement and of its consequences and to the size of the Error! Post not found for word:provider, in particular if the Error! Post not found for word:provider is an SME, including a start-up. The European Error! Post not found for word:data Protection Supervisor should have the power to impose fines on Union institutions, agencies and bodies falling within the scope of this Regulation.
(169) Compliance with the obligations on Error! Post not found for word:providers of general-purpose AI models imposed under this Regulation should be enforceable, inter alia, by means of fines. To that end, appropriate levels of fines should also be laid down for infringement of those obligations, including the failure to comply with measures requested by the Commission in accordance with this Regulation, Error! Post not found for word:subject to appropriate limitation periods in accordance with the principle of proportionality. All decisions taken by the Commission under this Regulation are Error! Post not found for word:subject to review by the Court of Justice of the European Union in accordance with the TFEU, including the unlimited jurisdiction of the Court of Justice with regard to penalties pursuant to Article 261 TFEU.
(170) Union and national law already provide effective remedies to natural and legal persons whose rights and freedoms are adversely affected by the use of Error! Post not found for word:ai systems. Without prejudice to those remedies, any natural or legal person that has grounds to consider that there has been an infringement of this Regulation should be entitled to lodge a complaint to the relevant market surveillance authority.
(171) Affected persons should have the right to obtain an explanation where a Error! Post not found for word:deployer’s decision is based mainly upon the output from certain high-Error! Post not found for word:risk Error! Post not found for word:ai systems that fall within the scope of this Regulation and where that decision produces legal effects or similarly significantly affects those persons in a way that they consider to have an adverse impact on their health, safety or fundamental rights. That explanation should be clear and meaningful and should provide a basis on which the affected persons are able to exercise their rights. The right to obtain an explanation should not apply to the use of Error! Post not found for word:ai systems for which exceptions or restrictions follow from Union or national law and should apply only to the extent this right is not already provided for under Union law.
(172) Persons acting as whistleblowers on the infringements of this Regulation should be protected under the Union law. Directive (EU) 2019/1937 of the European Parliament and of the Council(62) should therefore apply to the reporting of infringements of this Regulation and the protection of persons reporting such infringements.
(173) In order to ensure that the regulatory framework can be adapted where necessary, the power to adopt acts in accordance with Article 290 TFEU should be delegated to the Commission to amend the conditions under which an Error! Post not found for word:ai system is not to be considered to be high-Error! Post not found for word:risk, the list of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, the provisions regarding technical documentation, the content of the EU declaration of conformity the provisions regarding the conformity assessment procedures, the provisions establishing the high-Error! Post not found for word:risk Error! Post not found for word:ai systems to which the conformity assessment procedure based on assessment of the quality management system and assessment of the technical documentation should apply, the threshold, benchmarks and indicators, including by supplementing those benchmarks and indicators, in the rules for the classification of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk, the criteria for the designation of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk, the technical documentation for Error! Post not found for word:providers of general-purpose AI models and the transparency information for Error! Post not found for word:providers of general-purpose AI models. It is of particular importance that the Commission carry out appropriate consultations during its preparatory work, including at expert level, and that those consultations be conducted in accordance with the principles laid down in the Interinstitutional Agreement of 13 April 2016 on Better Law-Making(63). In particular, to ensure equal participation in the preparation of delegated acts, the European Parliament and the Council receive all documents at the same time as Member States’ experts, and their experts systematically have access to meetings of Commission expert groups dealing with the preparation of delegated acts.
(174) Given the rapid technological developments and the technical expertise required to effectively apply this Regulation, the Commission should evaluate and review this Regulation by 2 August 2029 and every four years thereafter and report to the European Parliament and the Council. In addition, taking into account the implications for the scope of this Regulation, the Commission should carry out an assessment of the need to amend the list of high-Error! Post not found for word:risk Error! Post not found for word:ai systems and the list of prohibited practices once a year. Moreover, by 2 August 2028 and every four years thereafter, the Commission should evaluate and report to the European Parliament and to the Council on the need to amend the list of high-Error! Post not found for word:risk areas in the annex to this Regulation, the Error! Post not found for word:ai systems within the scope of the transparency obligations, the effectiveness of the supervision and governance system and the progress on the development of standardisation deliverables on energy efficient development of general-purpose AI models, including the need for further measures or actions. Finally, by 2 August 2028 and every three years thereafter, the Commission should evaluate the impact and effectiveness of voluntary Error! Post not found for word:codes of conduct to foster the application of the requirements provided for high-Error! Post not found for word:risk Error! Post not found for word:ai systems in the case of Error! Post not found for word:ai systems other than high-Error! Post not found for word:risk Error! Post not found for word:ai systems and possibly other additional requirements for such Error! Post not found for word:ai systems.
(175) In order to ensure uniform conditions for the implementation of this Regulation, implementing powers should be conferred on the Commission. Those powers should be exercised in accordance with Regulation (EU) No 182/2011 of the European Parliament and of the Council(64).
(176) Since the objective of this Regulation, namely to improve the functioning of the internal market and to promote the uptake of human centric and trustworthy AI, while ensuring a high level of protection of health, safety, fundamental rights enshrined in the Charter, including democracy, the rule of law and environmental protection against harmful effects of Error! Post not found for word:ai systems in the Union and supporting innovation, cannot be sufficiently achieved by the Member States and can rather, by reason of the scale or effects of the action, be better achieved at Union level, the Union may adopt measures in accordance with the principle of subsidiarity as set out in Article 5 TEU. In accordance with the principle of proportionality as set out in that Article, this Regulation does not go beyond what is necessary in order to achieve that objective.
(177) In order to ensure legal certainty, ensure an appropriate adaptation period for Error! Post not found for word:operators and avoid disruption to the market, including by ensuring continuity of the use of Error! Post not found for word:ai systems, it is appropriate that this Regulation applies to the high-Error! Post not found for word:risk Error! Post not found for word:ai systems that have been placed on the market or put into service before the general date of application thereof, only if, from that date, those systems are Error! Post not found for word:subject to significant changes in their design or Error! Post not found for word:intended purpose. It is appropriate to clarify that, in this respect, the concept of significant change should be understood as equivalent in substance to the notion of substantial modification, which is used with regard only to high-Error! Post not found for word:risk Error! Post not found for word:ai systems pursuant to this Regulation. On an exceptional basis and in light of public Error! Post not found for word:accountability, Error! Post not found for word:operators of Error! Post not found for word:ai systems which are components of the large-scale IT systems established by the legal acts listed in an annex to this Regulation and Error! Post not found for word:operators of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are intended to be used by public authorities should, respectively, take the necessary steps to comply with the requirements of this Regulation by end of 2030 and by 2 August 2030.
(178) Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems are encouraged to start to comply, on a voluntary basis, with the relevant obligations of this Regulation already during the transitional period.
(179) This Regulation should apply from 2 August 2026. However, taking into account the unacceptable Error! Post not found for word:risk associated with the use of AI in certain ways, the prohibitions as well as the general provisions of this Regulation should already apply from 2 February 2025. While the full effect of those prohibitions follows with the establishment of the governance and enforcement of this Regulation, anticipating the application of the prohibitions is important to take account of unacceptable risks and to have an effect on other procedures, such as in civil law. Moreover, the infrastructure related to the governance and the conformity assessment system should be operational before 2 August 2026, therefore the provisions on notified bodies and governance structure should apply from 2 August 2025. Given the rapid pace of technological advancements and adoption of general-purpose AI models, obligations for Error! Post not found for word:providers of general-purpose AI models should apply from 2 August 2025. Codes of practice should be ready by…2 May 2025 in view of enabling Error! Post not found for word:providers to demonstrate compliance on time. The Error! Post not found for word:ai office should ensure that classification rules and procedures are up to date in light of technological developments. In addition, Member States should lay down and notify to the Commission the rules on penalties, including administrative fines, and ensure that they are properly and effectively implemented by the date of application of this Regulation. Therefore the provisions on penalties should apply from 2 August 2025.
(180) The European Error! Post not found for word:data Protection Supervisor and the European Error! Post not found for word:data Protection Board were consulted in accordance with Article 42(1) and (2) of Regulation (EU) 2018/1725 and delivered their joint opinion on 18 June 2021,
HAVE ADOPTED THIS REGULATION:
CHAPTER I – GENERAL PROVISIONS
Article 1 – Subject matter
- The purpose of this Regulation is to improve the functioning of the internal market and promote the uptake of human-centric and trustworthy artificial intelligence (AI), while ensuring a high level of protection of health, safety, fundamental rights enshrined in the Charter, including democracy, the rule of law and environmental protection, against the harmful effects of Error! Post not found for word:ai systems in the Union, and supporting innovation.
- This Regulation lays down:
(a) harmonised rules for the placing on the market, the putting into service, and the use of Error! Post not found for word:ai systems in the Union;
(b) prohibitions of certain AI practices;
(c) specific requirements for high-Error! Post not found for word:risk Error! Post not found for word:ai systems and obligations for Error! Post not found for word:operators of such systems;
(d) harmonised transparency rules for certain Error! Post not found for word:ai systems;
(e) harmonised rules for the placing on the market of general-purpose AI models;
(f) rules on market monitoring, market surveillance governance and enforcement;
(g) measures to support innovation, with a particular focus on SMEs, including start-ups.
Article 2 – Scope
- This Regulation applies to:
(a) Error! Post not found for word:providers placing on the market or putting into service Error! Post not found for word:ai systems or placing on the market general-purpose AI models in the Union, irrespective of whether those Error! Post not found for word:providers are established or located within the Union or in a third country;
(b) Error! Post not found for word:deployers of Error! Post not found for word:ai systems that have their place of establishment or are located within the Union;
(c) Error! Post not found for word:providers and Error! Post not found for word:deployers of Error! Post not found for word:ai systems that have their place of establishment or are located in a third country, where the output produced by the Error! Post not found for word:ai system is used in the Union;
(d) Error! Post not found for word:importers and Error! Post not found for word:distributors of Error! Post not found for word:ai systems;
(e) product manufacturers placing on the market or putting into service an Error! Post not found for word:ai system together with their product and under their own name or trademark;
(f) authorised Error! Post not found for word:representatives of Error! Post not found for word:providers, which are not established in the Union;
(g) affected persons that are located in the Union.
- For Error! Post not found for word:ai systems classified as high-Error! Post not found for word:risk Error! Post not found for word:ai systems in accordance with Article 6(1) related to products covered by the Union harmonisation legislation listed in Section B of Annex I, only Article 6(1), Article 102 to 109 and Article 112 apply. Article 57 applies only in so far as the requirements for high-Error! Post not found for word:risk Error! Post not found for word:ai systems under this Regulation have been integrated in that Union harmonisation legislation.
- This Regulation does not apply to areas outside the scope of Union law, and shall not, in any event, affect the competences of the Member States concerning national security, regardless of the type of entity entrusted by the Member States with carrying out tasks in relation to those competences.
This Regulation does not apply to Error! Post not found for word:ai systems where and in so far they are placed on the market, put into service, or used with or without modification exclusively for military, defence or national security purposes, regardless of the type of entity carrying out those activities.
This Regulation does not apply to Error! Post not found for word:ai systems which are not placed on the market or put into service in the Union, where the output is used in the Union exclusively for military, defence or national security purposes, regardless of the type of entity carrying out those activities.
- This Regulation applies neither to public authorities in a third country nor to international organisations falling within the scope of this Regulation pursuant to paragraph 1, where those authorities or organisations use Error! Post not found for word:ai systems in the framework of international cooperation or agreements for Error! Post not found for word:law enforcement and judicial cooperation with the Union or with one or more Member States, provided that such a third country or international organisation provides adequate safeguards with respect to the protection of fundamental rights and freedoms of individuals.
- This Regulation shall not affect the application of the provisions on the liability of Error! Post not found for word:providers of intermediary services as set out in Chapter II of Regulation (EU) 2022/2065.
- This Regulation does not apply to Error! Post not found for word:ai systems or AI models, including their output, specifically developed and put into service for the sole purpose of scientific research and development.
- Union law on the protection of Error! Post not found for word:personal Error! Post not found for word:data, privacy and the confidentiality of communications applies to Error! Post not found for word:personal Error! Post not found for word:data processed in connection with the rights and obligations laid down in this Regulation. This Regulation shall not affect Regulation (EU) 2016/679 or (EU) 2018/1725, or Directive 2002/58/EC or (EU) 2016/680, without prejudice to Article 10(5) and Article 59 of this Regulation.
- This Regulation does not apply to any research, testing or development activity regarding Error! Post not found for word:ai systems or AI models prior to their being placed on the market or put into service. Such activities shall be conducted in accordance with applicable Union law. Testing in real world conditions shall not be covered by that exclusion.
- This Regulation is without prejudice to the rules laid down by other Union legal acts related to Error! Post not found for word:consumer protection and product safety.
- This Regulation does not apply to obligations of Error! Post not found for word:deployers who are natural persons using Error! Post not found for word:ai systems in the course of a purely personal non-professional activity.
- This Regulation does not preclude the Union or Member States from maintaining or introducing laws, regulations or administrative provisions which are more favourable to workers in terms of protecting their rights in respect of the use of Error! Post not found for word:ai systems by employers, or from encouraging or allowing the application of collective agreements which are more favourable to workers.
- This Regulation does not apply to Error! Post not found for word:ai systems released under free and open-source licences, unless they are placed on the market or put into service as high-Error! Post not found for word:risk Error! Post not found for word:ai systems or as an Error! Post not found for word:ai system that falls under Article 5 or 50.
Article 3 – Definitions
For the purposes of this Regulation, the following definitions apply:
(1) ‘Error! Post not found for word:ai system’ means a machine-based system that is designed to operate with varying levels of autonomy, and that may exhibit adaptiveness after deployment and that, for explicit or implicit objectives, infers, from the input it receives, how to generate outputs such as predictions, content, recommendations, or decisions that can influence physical or virtual environments;
(2) ‘Error! Post not found for word:risk’ means the combination of the probability of an occurrence of harm and the severity of that harm;
(3) ‘Error! Post not found for word:provider’ means a natural or legal person, public authority, agency or other body that develops an Error! Post not found for word:ai system or a general-purpose AI model or that has an Error! Post not found for word:ai system or a general-purpose AI model developed and places it on the market or puts the Error! Post not found for word:ai system into service under its own name or trademark, whether for payment or free of charge;
(4) ‘Error! Post not found for word:deployer’ means a natural or legal person, public authority, agency or other body using an Error! Post not found for word:ai system under its authority except where the Error! Post not found for word:ai system is used in the course of a personal non-professional activity;
(5) ‘authorised representative’ means a natural or legal person located or established in the Union who has received and accepted a written mandate from a Error! Post not found for word:provider of an Error! Post not found for word:ai system or a general-purpose AI model to, respectively, perform and carry out on its behalf the obligations and procedures established by this Regulation;
(6) ‘Error! Post not found for word:importer’ means a natural or legal person located or established in the Union that places on the market an Error! Post not found for word:ai system that bears the name or trademark of a natural or legal person established in a third country;
(7) ‘Error! Post not found for word:distributor’ means a natural or legal person in the supply chain, other than the Error! Post not found for word:provider or the Error! Post not found for word:importer, that makes an Error! Post not found for word:ai system available on the Union market;
(8) ‘Error! Post not found for word:operator’ means a Error! Post not found for word:provider, product Error! Post not found for word:manufacturer, Error! Post not found for word:deployer, authorised representative, Error! Post not found for word:importer or Error! Post not found for word:distributor;
(9) ‘placing on the market’ means the first making available of an Error! Post not found for word:ai system or a general-purpose AI model on the Union market;
(10) ‘making available on the market’ means the supply of an Error! Post not found for word:ai system or a general-purpose AI model for distribution or use on the Union market in the course of a commercial activity, whether in return for payment or free of charge;
(11) ‘putting into service’ means the supply of an Error! Post not found for word:ai system for first use directly to the Error! Post not found for word:deployer or for own use in the Union for its Error! Post not found for word:intended purpose;
(12) ‘Error! Post not found for word:intended purpose’ means the use for which an Error! Post not found for word:ai system is intended by the Error! Post not found for word:provider, including the specific context and conditions of use, as specified in the information supplied by the Error! Post not found for word:provider in the instructions for use, promotional or sales materials and statements, as well as in the technical documentation;
(13) ‘reasonably foreseeable misuse’ means the use of an Error! Post not found for word:ai system in a way that is not in accordance with its Error! Post not found for word:intended purpose, but which may result from reasonably foreseeable human behaviour or interaction with other systems, including other Error! Post not found for word:ai systems;
(14) ‘safety Error! Post not found for word:component’ means a Error! Post not found for word:component of a product or of an Error! Post not found for word:ai system which fulfils a safety function for that product or Error! Post not found for word:ai system, or the failure or malfunctioning of which endangers the health and safety of persons or property;
(15) ‘instructions for use’ means the information provided by the Error! Post not found for word:provider to inform the Error! Post not found for word:deployer of in particular an Error! Post not found for word:ai system’s Error! Post not found for word:intended purpose and proper use;
(16) ‘recall of an AI system’ means any measure aiming to achieve the return to the Error! Post not found for word:provider or taking out of service or disabling the use of an Error! Post not found for word:ai system made available to Error! Post not found for word:deployers;
(17) ‘withdrawal of an AI system’ means any measure aiming to prevent an Error! Post not found for word:ai system in the supply chain being made available on the market;
(18) ‘performance of an AI system’ means the ability of an Error! Post not found for word:ai system to achieve its Error! Post not found for word:intended purpose;
(19) ‘notifying authority’ means the national authority responsible for setting up and carrying out the necessary procedures for the assessment, designation and notification of conformity assessment bodies and for their monitoring;
(20) ‘conformity assessment’ means the process of demonstrating whether the requirements set out in Chapter III, Section 2 relating to a high-Error! Post not found for word:risk Error! Post not found for word:ai system have been fulfilled;
(21) ‘conformity assessment body’ means a body that performs third-party conformity assessment activities, including testing, certification and inspection;
(22) ‘Error! Post not found for word:notified body’ means a conformity assessment body notified in accordance with this Regulation and other relevant Union harmonisation legislation;
(23) ‘substantial modification’ means a change to an Error! Post not found for word:ai system after its placing on the market or putting into service which is not foreseen or planned in the initial conformity assessment carried out by the Error! Post not found for word:provider and as a result of which the compliance of the Error! Post not found for word:ai system with the requirements set out in Chapter III, Section 2 is affected or results in a modification to the Error! Post not found for word:intended purpose for which the Error! Post not found for word:ai system has been assessed;
(24) ‘Error! Post not found for word:ce marking’ means a marking by which a Error! Post not found for word:provider indicates that an Error! Post not found for word:ai system is in conformity with the requirements set out in Chapter III, Section 2 and other applicable Union harmonisation legislation, providing for its affixing;
(25) ‘post-market monitoring system’ means all activities carried out by Error! Post not found for word:providers of Error! Post not found for word:ai systems to collect and review experience gained from the use of Error! Post not found for word:ai systems they place on the market or put into service for the purpose of identifying any need to immediately apply any necessary corrective or preventive actions;
(26) ‘market surveillance authority’ means the national authority carrying out the activities and taking the measures pursuant to Regulation (EU) 2019/1020;
(27) ‘harmonised standard’ means a harmonised standard as defined in Article 2(1), point (c), of Regulation (EU) No 1025/2012;
(28) ‘common specification’ means a set of technical specifications as defined in Article 2, point (4) of Regulation (EU) No 1025/2012, providing means to comply with certain requirements established under this Regulation;
(29) ‘Error! Post not found for word:training Error! Post not found for word:data’ means Error! Post not found for word:data used for training an Error! Post not found for word:ai system through fitting its learnable parameters;
(30) ‘Error! Post not found for word:validation Error! Post not found for word:data’ means Error! Post not found for word:data used for providing an evaluation of the trained Error! Post not found for word:ai system and for tuning its non-learnable parameters and its learning process in order, inter alia, to prevent underfitting or overfitting;
(31) ‘Error! Post not found for word:validation Error! Post not found for word:data set’ means a separate Error! Post not found for word:data set or part of the Error! Post not found for word:training Error! Post not found for word:data set, either as a fixed or variable split;
(32) ‘Error! Post not found for word:testing Error! Post not found for word:data’ means Error! Post not found for word:data used for providing an independent evaluation of the Error! Post not found for word:ai system in order to confirm the expected performance of that system before its placing on the market or putting into service;
(33) ‘Error! Post not found for word:input data’ means Error! Post not found for word:data provided to or directly acquired by an Error! Post not found for word:ai system on the basis of which the system produces an output;
(34) ‘Error! Post not found for word:biometric Error! Post not found for word:data’ means Error! Post not found for word:personal Error! Post not found for word:data resulting from specific technical Error! Post not found for word:processing relating to the physical, physiological or behavioural characteristics of a natural person, such as facial images or dactyloscopic Error! Post not found for word:data;
(35) ‘biometric identification’ means the automated recognition of physical, physiological, behavioural, or psychological human features for the purpose of establishing the identity of a natural person by comparing Error! Post not found for word:biometric Error! Post not found for word:data of that individual to Error! Post not found for word:biometric Error! Post not found for word:data of individuals stored in a database;
(36) ‘biometric verification’ means the automated, one-to-one verification, including authentication, of the identity of natural persons by comparing their Error! Post not found for word:biometric Error! Post not found for word:data to previously provided Error! Post not found for word:biometric Error! Post not found for word:data;
(37) ‘special categories of personal data’ means the categories of Error! Post not found for word:personal Error! Post not found for word:data referred to in Article 9(1) of Regulation (EU) 2016/679, Article 10 of Directive (EU) 2016/680 and Article 10(1) of Regulation (EU) 2018/1725;
(38) ‘sensitive operational data’ means operational Error! Post not found for word:data related to activities of prevention, detection, investigation or prosecution of criminal offences, the disclosure of which could jeopardise the integrity of criminal proceedings;
(39) ‘emotion recognition system’ means an Error! Post not found for word:ai system for the purpose of identifying or inferring emotions or intentions of natural persons on the basis of their Error! Post not found for word:biometric Error! Post not found for word:data;
(40) ‘biometric categorisation system’ means an Error! Post not found for word:ai system for the purpose of assigning natural persons to specific categories on the basis of their Error! Post not found for word:biometric Error! Post not found for word:data, unless it is ancillary to another commercial service and strictly necessary for objective technical reasons;
(41) ‘remote biometric identification system’ means an Error! Post not found for word:ai system for the purpose of identifying natural persons, without their active involvement, typically at a distance through the comparison of a person’s Error! Post not found for word:biometric Error! Post not found for word:data with the Error! Post not found for word:biometric Error! Post not found for word:data contained in a reference database;
(42) ‘real-time remote biometric identification system’ means a remote biometric identification system whereby the capturing of Error! Post not found for word:biometric Error! Post not found for word:data, the comparison and the identification all occur without a significant delay, comprising not only instant identification, but also limited short delays in order to avoid circumvention;
(43) ‘post-remote biometric identification system’ means a remote biometric identification system other than a real-time remote biometric identification system;
(44) ‘publicly accessible space’ means any publicly or privately owned physical place accessible to an undetermined number of natural persons, regardless of whether certain conditions for access may apply, and regardless of the potential capacity restrictions;
(45) ‘law enforcement authority’ means:
(a) any public authority competent for the prevention, investigation, detection or prosecution of criminal offences or the execution of criminal penalties, including the safeguarding against and the prevention of threats to public security; or
(b) any other body or entity entrusted by Member State law to exercise public authority and public powers for the purposes of the prevention, investigation, detection or prosecution of criminal offences or the execution of criminal penalties, including the safeguarding against and the prevention of threats to public security;
(46) ‘Error! Post not found for word:law enforcement’ means activities carried out by Error! Post not found for word:law enforcement authorities or on their behalf for the prevention, investigation, detection or prosecution of criminal offences or the execution of criminal penalties, including safeguarding against and preventing threats to public security;
(47) ‘Error! Post not found for word:ai office’ means the Commission’s function of contributing to the implementation, monitoring and supervision of Error! Post not found for word:ai systems and general-purpose AI models, and AI governance provided for in Commission Decision of 24 January 2024; references in this Regulation to the Error! Post not found for word:ai office shall be construed as references to the Commission;
(48) ‘national competent authority’ means a notifying authority or a market surveillance authority; as regards Error! Post not found for word:ai systems put into service or used by Union institutions, agencies, offices and bodies, references to national competent authorities or market surveillance authorities in this Regulation shall be construed as references to the European Error! Post not found for word:data Protection Supervisor;
(49) ‘Error! Post not found for word:serious Error! Post not found for word:incident’ means an Error! Post not found for word:incident or malfunctioning of an Error! Post not found for word:ai system that directly or indirectly leads to any of the following:
(a) the death of a person, or serious harm to a person’s health;
(b) a serious and irreversible disruption of the management or operation of critical infrastructure.
(c) the infringement of obligations under Union law intended to protect fundamental rights;
(d) serious harm to property or the environment;
(50) ‘Error! Post not found for word:personal Error! Post not found for word:data’ means Error! Post not found for word:personal Error! Post not found for word:data as defined in Article 4, point (1), of Regulation (EU) 2016/679;
(51) ‘Error! Post not found for word:non\-personal Error! Post not found for word:data’ means Error! Post not found for word:data other than Error! Post not found for word:personal Error! Post not found for word:data as defined in Article 4, point (1), of Regulation (EU) 2016/679;
(52) ‘Error! Post not found for word:profiling’ means Error! Post not found for word:profiling as defined in Article 4, point (4), of Regulation (EU) 2016/679;
(53) ‘real-world testing plan’ means a document that describes the objectives, methodology, geographical, population and temporal scope, monitoring, organisation and conduct of testing in real-world conditions;
(54) ‘Error! Post not found for word:sandbox plan’ means a document agreed between the participating Error! Post not found for word:provider and the competent authority describing the objectives, conditions, timeframe, methodology and requirements for the activities carried out within the sandbox;
(55) ‘AI regulatory sandbox’ means a controlled framework set up by a competent authority which offers Error! Post not found for word:providers or prospective Error! Post not found for word:providers of Error! Post not found for word:ai systems the possibility to develop, train, validate and test, where appropriate in real-world conditions, an innovative Error! Post not found for word:ai system, pursuant to a Error! Post not found for word:sandbox plan for a limited time under regulatory supervision;
(56) ‘Error! Post not found for word:ai literacy’ means skills, knowledge and understanding that allow Error! Post not found for word:providers, Error! Post not found for word:deployers and affected persons, taking into account their respective rights and obligations in the context of this Regulation, to make an informed deployment of Error! Post not found for word:ai systems, as well as to gain awareness about the opportunities and risks of AI and possible harm it can cause;
(57) ‘testing in real-world conditions’ means the temporary testing of an Error! Post not found for word:ai system for its Error! Post not found for word:intended purpose in real-world conditions outside a laboratory or otherwise simulated environment, with a view to gathering reliable and robust Error! Post not found for word:data and to assessing and verifying the conformity of the Error! Post not found for word:ai system with the requirements of this Regulation and it does nor qualify as placing the Error! Post not found for word:ai system on the market or putting it into service within the meaning of this Regulation, provided that all the conditions laid down in Article 57 or 60 are fulfilled;
(58) ‘Error! Post not found for word:subject’, for the purpose of real-world testing, means a natural person who participates in testing in real-world conditions;
(59) ‘Error! Post not found for word:informed Error! Post not found for word:consent’ means a Error! Post not found for word:subject’s freely given, specific, unambiguous and voluntary expression of his or her willingness to participate in a particular testing in real-world conditions, after having been informed of all aspects of the testing that are relevant to the Error! Post not found for word:subject’s decision to participate;
(60) ‘Error! Post not found for word:deep fake’ means AI-generated or manipulated image, audio or video content that resembles existing persons, objects, places, entities or events and would falsely appear to a person to be authentic or truthful;
(61) ‘widespread infringement’ means any act or omission contrary to Union law protecting the interest of individuals, which:
(a) has harmed or is likely to harm the collective interests of individuals residing in at least two Member States other than the Member State in which:
(i) the act or omission originated or took place;
(ii) the Error! Post not found for word:provider concerned, or, where applicable, its authorised representative is located or established; or
(iii) the Error! Post not found for word:deployer is established, when the infringement is committed by the Error! Post not found for word:deployer;
(b) has caused, causes or is likely to cause harm to the collective interests of individuals and has common features, including the same unlawful practice or the same interest being infringed, and is occurring concurrently, committed by the same Error! Post not found for word:operator, in at least three Member States;
(62) ‘critical infrastructure’ means critical infrastructure as defined in Article 2, point (4), of Directive (EU) 2022/2557;
(63) ‘general-purpose AI model’ means an AI model, including where such an AI model is trained with a large amount of Error! Post not found for word:data using self-supervision at scale, that displays significant generality and is capable of competently performing a wide range of distinct tasks regardless of the way the model is placed on the market and that can be integrated into a variety of downstream systems or applications, except AI models that are used for research, development or prototyping activities before they are placed on the market;
(64) ‘high-impact capabilities’ means capabilities that match or exceed the capabilities recorded in the most advanced general-purpose AI models;
(65) ‘Error! Post not found for word:systemic Error! Post not found for word:risk’ means a Error! Post not found for word:risk that is specific to the high-impact capabilities of general-purpose AI models, having a significant impact on the Union market due to their reach, or due to actual or reasonably foreseeable negative effects on public health, safety, public security, fundamental rights, or the society as a whole, that can be propagated at scale across the value chain;
(66) ‘general-purpose AI system’ means an Error! Post not found for word:ai system which is based on a general-purpose AI model, and which has the capability to serve a variety of purposes, both for direct use as well as for integration in other Error! Post not found for word:ai systems;
(67) ‘floating-point operation’ means any mathematical operation or assignment involving floating-point numbers, which are a subset of the real numbers typically represented on computers by an integer of fixed precision scaled by an integer exponent of a fixed base;
(68) ‘downstream provider’ means a Error! Post not found for word:provider of an Error! Post not found for word:ai system, including a general-purpose AI system, which integrates an AI model, regardless of whether the AI model is provided by themselves and vertically integrated or provided by another entity based on contractual relations.
Article 4 – AI literacy
Error! Post not found for word:providers and Error! Post not found for word:deployers of Error! Post not found for word:ai systems shall take measures to ensure, to their best extent, a sufficient level of Error! Post not found for word:ai literacy of their staff and other persons dealing with the operation and use of Error! Post not found for word:ai systems on their behalf, taking into account their technical knowledge, experience, education and training and the context the Error! Post not found for word:ai systems are to be used in, and considering the persons or groups of persons on whom the Error! Post not found for word:ai systems are to be used.
CHAPTER II – PROHIBITED AI PRACTICES
Article 5 – Prohibited AI Practices
- The following AI practices shall be prohibited:
(a) the placing on the market, the putting into service or the use of an Error! Post not found for word:ai system that deploys subliminal techniques beyond a person’s consciousness or purposefully manipulative or deceptive techniques, with the objective, or the effect of, materially distorting the behaviour of a person or a group of persons by appreciably impairing their ability to make an informed decision, thereby causing them to take a decision that they would not have otherwise taken in a manner that causes or is reasonably likely to cause that person, another person or group of persons significant harm;
(b) the placing on the market, the putting into service or the use of an Error! Post not found for word:ai system that exploits any of the vulnerabilities of a natural person or a specific group of persons due to their age, disability or a specific social or economic situation, with the objective, or the effect, of materially distorting the behaviour of that person or a person belonging to that group in a manner that causes or is reasonably likely to cause that person or another person significant harm;
(c) the placing on the market, the putting into service or the use of Error! Post not found for word:ai systems for the evaluation or classification of natural persons or groups of persons over a certain period of time based on their social behaviour or known, inferred or predicted personal or personality characteristics, with the social score leading to either or both of the following:
(i) detrimental or unfavourable treatment of certain natural persons or groups of persons in social contexts that are unrelated to the contexts in which the Error! Post not found for word:data was originally generated or collected;
(ii) detrimental or unfavourable treatment of certain natural persons or groups of persons that is unjustified or disproportionate to their social behaviour or its gravity;
(d) the placing on the market, the putting into service for this specific purpose, or the use of an Error! Post not found for word:ai system for making Error! Post not found for word:risk assessments of natural persons in order to assess or predict the Error! Post not found for word:risk of a natural person committing a criminal offence, based solely on the Error! Post not found for word:profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to Error! Post not found for word:ai systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity;
(e) the placing on the market, the putting into service for this specific purpose, or the use of Error! Post not found for word:ai systems that create or expand facial recognition databases through the untargeted scraping of facial images from the internet or CCTV footage;
(f) the placing on the market, the putting into service for this specific purpose, or the use of Error! Post not found for word:ai systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the Error! Post not found for word:ai system is intended to be put in place or into the market for medical or safety reasons.
(g) the placing on the market, the putting into service for this specific purpose, or the use of biometric categorisation systems that categorise individually natural persons based on their Error! Post not found for word:biometric Error! Post not found for word:data to deduce or infer their race, political opinions, trade union membership, religious or philosophical beliefs, sex life or sexual orientation; this prohibition does not cover any labelling or filtering of lawfully acquired biometric datasets, such as images, based on Error! Post not found for word:biometric Error! Post not found for word:data or categorizing of Error! Post not found for word:biometric Error! Post not found for word:data in the area of Error! Post not found for word:law enforcement;
(h) the use of ‘real-time’ remote biometric identification systems in publicly accessible spaces for the purposes of Error! Post not found for word:law enforcement, unless and in so far as such use is strictly necessary for one of the following objectives:
- (i) the targeted search for specific victims of abduction, trafficking in human beings or sexual exploitation of human beings, as well as the search for missing persons;
- (ii) the prevention of a specific, substantial and imminent threat to the life or physical safety of natural persons or a genuine and present or genuine and foreseeable threat of a terrorist attack;
- (iii) the localisation or identification of a person suspected of having committed a criminal offence, for the purpose of conducting a criminal investigation, or prosecution or executing a criminal penalty for offences referred to in Annex II and punishable in the Member State concerned by a custodial sentence or a detention order for a maximum period of at least four years;
Point (h) of the first subparagraph is without prejudice to Article 9 of Regulation (EU) 2016/679 for the Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data for purposes other than Error! Post not found for word:law enforcement.
- The use of ‘real-time’ remote biometric identification systems in publicly accessible spaces for the purposes of Error! Post not found for word:law enforcement for any of the objectives referred to in paragraph 1, first subparagraph, point (h), shall be deployed for the purposes set out in that point only to confirm the identity of the specifically targeted individual, and it shall take into account the following elements:
(a) the nature of the situation giving rise to the possible use, in particular the seriousness, probability and scale of the harm that would be caused if the system were not used;
(b) the consequences of the use of the system for the rights and freedoms of all persons concerned, in particular the seriousness, probability and scale of those consequences.
In addition, the use of ‘real-time’ remote biometric identification systems in publicly accessible spaces for the purposes of Error! Post not found for word:law enforcement for any of the objectives referred to in paragraph 1, first subparagraph, point (h), of this Article shall comply with necessary and proportionate safeguards and conditions in relation to the use in accordance with the national law authorising the use thereof, in particular as regards the temporal, geographic and personal limitations. The use of the ‘real-time’ remote biometric identification system in publicly accessible spaces shall be authorised only if the law enforcement authority has completed a fundamental rights impact assessment as provided for in Article 27 and has registered the system in the EU database according to Article 49. However, in duly justified cases of urgency, the use of such systems may be commenced without the registration in the EU database, provided that such registration is completed without undue delay.
- For the purposes of paragraph 1, first subparagraph, point (h) and paragraph 2, each use for the purposes of Error! Post not found for word:law enforcement of a ‘real-time’ remote biometric identification system in publicly accessible spaces shall be Error! Post not found for word:subject to a prior authorisation granted by a judicial authority or an independent administrative authority whose decision is binding of the Member State in which the use is to take place, issued upon a reasoned request and in accordance with the detailed rules of national law referred to in paragraph 5. However, in a duly justified situation of urgency, the use of such system may be commenced without an authorisation provided that such authorisation is requested without undue delay, at the latest within 24 hours. If such authorisation is rejected, the use shall be stopped with immediate effect and all the Error! Post not found for word:data, as well as the results and outputs of that use shall be immediately discarded and deleted.
The competent judicial authority or an independent administrative authority whose decision is binding shall grant the authorisation only where it is satisfied, on the basis of objective evidence or clear indications presented to it, that the use of the ‘real-time’ remote biometric identification system concerned is necessary for, and proportionate to, achieving one of the objectives specified in paragraph 1, first subparagraph, point (h), as identified in the request and, in particular, remains limited to what is strictly necessary concerning the period of time as well as the geographic and personal scope. In deciding on the request, that authority shall take into account the elements referred to in paragraph 2. No decision that produces an adverse legal effect on a person may be taken based solely on the output of the ‘real-time’ remote biometric identification system.
- Without prejudice to paragraph 3, each use of a ‘real-time’ remote biometric identification system in publicly accessible spaces for Error! Post not found for word:law enforcement purposes shall be notified to the relevant market surveillance authority and the national Error! Post not found for word:data protection authority in accordance with the national rules referred to in paragraph 5. The notification shall, as a minimum, contain the information specified under paragraph 6 and shall not include sensitive operational data.
- A Member State may decide to provide for the possibility to fully or partially authorise the use of ‘real-time’ remote biometric identification systems in publicly accessible spaces for the purposes of Error! Post not found for word:law enforcement within the limits and under the conditions listed in paragraph 1, first subparagraph, point (h), and paragraphs 2 and 3. Member States concerned shall lay down in their national law the necessary detailed rules for the request, issuance and exercise of, as well as supervision and reporting relating to, the authorisations referred to in paragraph 3. Those rules shall also specify in respect of which of the objectives listed in paragraph 1, first subparagraph, point (h), including which of the criminal offences referred to in point (h)(iii) thereof, the competent authorities may be authorised to use those systems for the purposes of Error! Post not found for word:law enforcement. Member States shall notify those rules to the Commission at the latest 30 days following the adoption thereof. Member States may introduce, in accordance with Union law, more restrictive laws on the use of remote biometric identification systems.
- National market surveillance authorities and the national Error! Post not found for word:data protection authorities of Member States that have been notified of the use of ‘real-time’ remote biometric identification systems in publicly accessible spaces for Error! Post not found for word:law enforcement purposes pursuant to paragraph 4 shall submit to the Commission annual reports on such use. For that purpose, the Commission shall provide Member States and national market surveillance and Error! Post not found for word:data protection authorities with a template, including information on the number of the decisions taken by competent judicial authorities or an independent administrative authority whose decision is binding upon requests for authorisations in accordance with paragraph 3 and their result.
- The Commission shall publish annual reports on the use of real-time remote biometric identification systems in publicly accessible spaces for Error! Post not found for word:law enforcement purposes, based on aggregated Error! Post not found for word:data in Member States on the basis of the annual reports referred to in paragraph 6. Those annual reports shall not include sensitive operational data of the related Error! Post not found for word:law enforcement activities.
- This Article shall not affect the prohibitions that apply where an AI practice infringes other Union law.
CHAPTER III – HIGH-RISK AI SYSTEMS
Section 1 – Classification of AI systems as high-risk
Article 6 – Classification rules for high-risk AI systems
- Irrespective of whether an Error! Post not found for word:ai system is placed on the market or put into service independently of the products referred to in points (a) and (b), that Error! Post not found for word:ai system shall be considered to be high-Error! Post not found for word:risk where both of the following conditions are fulfilled:
(a) the Error! Post not found for word:ai system is intended to be used as a safety component of a product, or the Error! Post not found for word:ai system is itself a product, covered by the Union harmonisation legislation listed in Annex I;
(b) the product whose safety Error! Post not found for word:component pursuant to point (a) is the Error! Post not found for word:ai system, or the Error! Post not found for word:ai system itself as a product, is required to undergo a third-party conformity assessment, with a view to the placing on the market or the putting into service of that product pursuant to the Union harmonisation legislation listed in Annex I.
- In addition to the high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in paragraph 1, Error! Post not found for word:ai systems referred to in Annex III shall be considered to be high-Error! Post not found for word:risk.
- By derogation from paragraph 2, an Error! Post not found for word:ai system referred to in Annex II shall not be considered to be high-Error! Post not found for word:risk where it does not pose a significant Error! Post not found for word:risk of harm to the health, safety or fundamental rights of natural persons, including by not materially influencing the outcome of decision making.
The first subparagraph shall apply where any of the following conditions is fulfilled:
(a) the Error! Post not found for word:ai system is intended to perform a narrow procedural task;
(b) the Error! Post not found for word:ai system is intended to improve the result of a previously completed human activity;
(c) the Error! Post not found for word:ai system is intended to detect decision-making patterns or deviations from prior decision-making patterns and is not meant to replace or influence the previously completed human assessment, without proper human review; or
(d) the Error! Post not found for word:ai system is intended to perform a preparatory task to an assessment relevant for the purposes of the use cases listed in Annex III.
Notwithstanding the first subparagraph, an Error! Post not found for word:ai system referred to in Annex III shall always be considered to be high-Error! Post not found for word:risk where the Error! Post not found for word:ai system performs Error! Post not found for word:profiling of natural persons.
- A Error! Post not found for word:provider who considers that an Error! Post not found for word:ai system referred to in Annex III is not high-Error! Post not found for word:risk shall document its assessment before that system is placed on the market or put into service. Such Error! Post not found for word:provider shall be Error! Post not found for word:subject to the registration obligation set out in Article 49(2). Upon request of national competent authorities, the Error! Post not found for word:provider shall provide the documentation of the assessment.
- The Commission shall, after consulting the European Artificial Intelligence Board (the ‘Board’), and no later than 2 February 2026, provide guidelines specifying the practical implementation of this Article in line with Article 96 together with a comprehensive list of practical examples of use cases of Error! Post not found for word:ai systems that are high-Error! Post not found for word:risk and not high-Error! Post not found for word:risk.
- The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend paragraph 3, second subparagraph, of this Article by adding new conditions to those laid therein, or by modifying them, where there is concrete and reliable evidence of the existence of Error! Post not found for word:ai systems that fall under the scope of Annex III but do not pose a significant Error! Post not found for word:risk of harm to the health, safety or fundamental rights of natural persons.
- The Commission shall adopt delegated acts in accordance with Article 97 in order to amend paragraph 2, second subparagraph, of this Article by deleting any of the conditions laid down therein, where there is concrete and reliable evidence that this is necessary to maintain the level of protection of health, safety and fundamental rights provided for by this Regulation.
- Any amendment to the conditions laid down in paragraph 3, second subparagraph, adopted in accordance with paragraphs 6 and 7 of this Article shall not decrease the overall level of protection of health, safety and fundamental rights provided for by this Regulation and shall ensure consistency with the delegated acts adopted pursuant to Article 7(1), and take account of market and technological developments.
Article 7 – Amendments to Annex III
- The Commission is empowered to adopt delegated acts in accordance with Article 97 to amend Annex III by adding or modifying use-cases of high-Error! Post not found for word:risk Error! Post not found for word:ai systems where both of the following conditions are fulfilled:
(a) the Error! Post not found for word:ai systems are intended to be used in any of the areas listed in Annex III;
(b) the Error! Post not found for word:ai systems pose a Error! Post not found for word:risk of harm to health and safety, or an adverse impact on fundamental rights, and that Error! Post not found for word:risk is equivalent to, or greater than, the Error! Post not found for word:risk of harm or of adverse impact posed by the high-Error! Post not found for word:risk Error! Post not found for word:ai systems already referred to in Annex III.
- When assessing the condition under paragraph 1, point (b), the Commission shall take into account the following criteria:
(a) the Error! Post not found for word:intended purpose of the Error! Post not found for word:ai system;
(b) the extent to which an Error! Post not found for word:ai system has been used or is likely to be used;
(c) the nature and amount of the Error! Post not found for word:data processed and used by the Error! Post not found for word:ai system, in particular whether special categories of personal data are processed;
(d) the extent to which the Error! Post not found for word:ai system acts autonomously and the possibility for a human to override a decision or recommendations that may lead to potential harm;
(e) the extent to which the use of an Error! Post not found for word:ai system has already caused harm to health and safety, has had an adverse impact on fundamental rights or has given rise to significant concerns in relation to the likelihood of such harm or adverse impact, as demonstrated, for example, by reports or documented allegations submitted to national competent authorities or by other reports, as appropriate;
(f) the potential extent of such harm or such adverse impact, in particular in terms of its intensity and its ability to affect multiple persons or to disproportionately affect a particular group of persons;
(g) the extent to which persons who are potentially harmed or suffer an adverse impact are dependent on the outcome produced with an Error! Post not found for word:ai system, in particular because for practical or legal reasons it is not reasonably possible to opt-out from that outcome;
(h) the extent to which there is an imbalance of power, or the persons who are potentially harmed or suffer an adverse impact are in a vulnerable position in relation to the Error! Post not found for word:deployer of an Error! Post not found for word:ai system, in particular due to status, authority, knowledge, economic or social circumstances, or age;
(i) the extent to which the outcome produced involving an Error! Post not found for word:ai system is easily corrigible or reversible, taking into account the technical solutions available to correct or reverse it, whereby outcomes having an adverse impact on health, safety or fundamental rights, shall not be considered to be easily corrigible or reversible;
(j) the magnitude and likelihood of benefit of the deployment of the Error! Post not found for word:ai system for individuals, groups, or society at large, including possible improvements in product safety;
(k) the extent to which existing Union law provides for:
(i) effective measures of redress in relation to the risks posed by an Error! Post not found for word:ai system, with the exclusion of claims for damages;
(ii) effective measures to prevent or substantially minimise those risks.
- The Commission is empowered to adopt delegated acts in accordance with Article 97 to amend the list in Annex III by removing high-Error! Post not found for word:risk Error! Post not found for word:ai systems where both of the following conditions are fulfilled:
(a) the high-Error! Post not found for word:risk Error! Post not found for word:ai system concerned no longer poses any significant risks to fundamental rights, health or safety, taking into account the criteria listed in paragraph 2;
(b) the deletion does not decrease the overall level of protection of health, safety and fundamental rights under Union law.
Section 2 – Requirements for high-risk AI systems
Article 8 – Compliance with the requirements
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall comply with the requirements laid down in this Section, taking into account their Error! Post not found for word:intended purpose as well as the generally acknowledged state of the art on AI and AI-related technologies. The Error! Post not found for word:risk management system referred to in Article 9 shall be taken into account when ensuring compliance with those requirements.
- Where a product contains an Error! Post not found for word:ai system, to which the requirements of this Regulation as well as requirements of the Union harmonisation legislation listed in Section A of Annex I apply, Error! Post not found for word:providers shall be responsible for ensuring that their product is fully compliant with all applicable requirements under applicable Union harmonisation legislation. In ensuring the compliance of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in paragraph 1 with the requirements set out in this Section, and in order to ensure consistency, avoid duplication and minimise additional burdens, Error! Post not found for word:providers shall have a choice of integrating, as appropriate, the necessary testing and reporting processes, information and documentation they provide with regard to their product into documentation and procedures that already exist and are required under the Union harmonisation legislation listed in Section A of Annex I,.
Article 9 – Risk management system
- A Error! Post not found for word:risk management system shall be established, implemented, documented and maintained in relation to high-Error! Post not found for word:risk Error! Post not found for word:ai systems.
- The Error! Post not found for word:risk management system shall be understood as a continuous iterative process planned and run throughout the entire lifecycle of a high-Error! Post not found for word:risk Error! Post not found for word:ai system, requiring regular systematic review and updating. It shall comprise the following steps:
(a) the identification and analysis of the known and the reasonably foreseeable risks that the high-Error! Post not found for word:risk Error! Post not found for word:ai system can pose to health, safety or fundamental rights when the high-Error! Post not found for word:risk Error! Post not found for word:ai system is used in accordance with its Error! Post not found for word:intended purpose;
(b) the estimation and evaluation of the risks that may emerge when the high-Error! Post not found for word:risk Error! Post not found for word:ai system is used in accordance with its Error! Post not found for word:intended purpose, and under conditions of reasonably foreseeable misuse;
(c) the evaluation of other risks possibly arising, based on the analysis of Error! Post not found for word:data gathered from the post-market monitoring system referred to in Article 72;
(d) the adoption of appropriate and targeted Error! Post not found for word:risk management measures designed to address the risks identified pursuant to point (a) .
- The risks referred to in this Article shall concern only those which may be reasonably mitigated or eliminated through the development or design of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, or the provision of adequate technical information.
- The Error! Post not found for word:risk management measures referred to in paragraph 2, point (d), shall give due consideration to the effects and possible interaction resulting from the combined application of the requirements set out in this Section, with a view to minimising risks more effectively while achieving an appropriate balance in implementing the measures to fulfil those requirements.
- The Error! Post not found for word:risk management measures referred to in paragraph 2, point (d), shall be such that the relevant residual Error! Post not found for word:risk associated with each hazard, as well as the overall residual Error! Post not found for word:risk of the high-Error! Post not found for word:risk Error! Post not found for word:ai systems is judged to be acceptable.
In identifying the most appropriate Error! Post not found for word:risk management measures, the following shall be ensured:
(a) elimination or reduction of risks identified and evaluated pursuant to paragraph 2 in as far as technically feasible through adequate design and development of the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(b) where appropriate, implementation of adequate mitigation and control measures addressing risks that cannot be eliminated;
(c) provision of information required pursuant to Article 13 and, where appropriate, training to Error! Post not found for word:deployers.
With a view to eliminating or reducing risks related to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, due consideration shall be given to the technical knowledge, experience, education, the training to be expected by the Error! Post not found for word:deployer, and the presumable context in which the system is intended to be used.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be tested for the purpose of identifying the most appropriate and targeted Error! Post not found for word:risk management measures. Testing shall ensure that high-Error! Post not found for word:risk Error! Post not found for word:ai systems perform consistently for their Error! Post not found for word:intended purpose and that they are in compliance with the requirements set out in this Section.
- Testing procedures may include testing in real-world conditions in accordance with Article 60.
- The testing of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be performed, as appropriate, at any time throughout the development process, and, in any event, prior to their being placed on the market or put into service. Testing shall be carried out against prior defined metrics and probabilistic thresholds that are appropriate to the Error! Post not found for word:intended purpose of the high-Error! Post not found for word:risk Error! Post not found for word:ai system.
- When implementing the Error! Post not found for word:risk management system as provided for in paragraphs 1 to 7, Error! Post not found for word:providers shall give consideration to whether in view of its Error! Post not found for word:intended purpose the high-Error! Post not found for word:risk Error! Post not found for word:ai system is likely to have an adverse impact on persons under the age of 18 and, as appropriate, other vulnerable groups.
- For Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are Error! Post not found for word:subject to requirements regarding internal Error! Post not found for word:risk management processes under other relevant provisions of Union law, the aspects provided in paragraphs 1 to 9 may be part of, or combined with, the Error! Post not found for word:risk management procedures established pursuant to that law.
Article 10 – Data and data governance
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems which make use of techniques involving the training of AI models with Error! Post not found for word:data shall be developed on the basis of training, validation and Error! Post not found for word:testing Error! Post not found for word:data sets that meet the quality criteria referred to in paragraphs 2 to 5 whenever such Error! Post not found for word:data sets are used.
- Training, validation and Error! Post not found for word:testing Error! Post not found for word:data sets shall be Error! Post not found for word:subject to Error! Post not found for word:data governance and management practices appropriate for the Error! Post not found for word:intended purpose of the high-Error! Post not found for word:risk Error! Post not found for word:ai system. Those practices shall concern in particular:
(a) the relevant design choices;
(b) Error! Post not found for word:data collection processes and the origin of Error! Post not found for word:data, and in the case of Error! Post not found for word:personal Error! Post not found for word:data, the original purpose of the Error! Post not found for word:data collection;(c) relevant Error! Post not found for word:data-preparation Error! Post not found for word:processing operations, such as annotation, labelling, cleaning, updating, enrichment and aggregation;
(d) the formulation of assumptions, in particular with respect to the information that the Error! Post not found for word:data are supposed to measure and represent;
(e) an assessment of the Error! Post not found for word:availability, quantity and suitability of the Error! Post not found for word:data sets that are needed;
(f) examination in view of possible biases that are likely to affect the health and safety of persons, have a negative impact on fundamental rights or lead to discrimination prohibited under Union law, especially where Error! Post not found for word:data outputs influence inputs for future operations;
(g) appropriate measures to detect, prevent and mitigate possible biases identified according to point (f);
(h) the identification of relevant Error! Post not found for word:data gaps or shortcomings that prevent compliance with this Regulation, and how those gaps and shortcomings can be addressed.
- Training, validation and Error! Post not found for word:testing Error! Post not found for word:data sets shall be relevant, sufficiently representative, and to the best extent possible, free of errors and complete in view of the Error! Post not found for word:intended purpose. They shall have the appropriate statistical properties, including, where applicable, as regards the persons or groups of persons in relation to whom the high-Error! Post not found for word:risk Error! Post not found for word:ai system is intended to be used. Those characteristics of the Error! Post not found for word:data sets may be met at the level of individual Error! Post not found for word:data sets or at the level of a combination thereof.
- Error! Post not found for word:data sets shall take into account, to the extent required by the Error! Post not found for word:intended purpose, the characteristics or elements that are particular to the specific geographical, contextual, behavioural or functional setting within which the high-Error! Post not found for word:risk Error! Post not found for word:ai system is intended to be used.
- To the extent that it is strictly necessary for the purpose of ensuring bias detection and correction in relation to the high-Error! Post not found for word:risk Error! Post not found for word:ai systems in accordance with paragraph (2), points (f) and (g) of this Article, the Error! Post not found for word:providers of such systems may exceptionally process special categories of personal data, Error! Post not found for word:subject to appropriate safeguards for the fundamental rights and freedoms of natural persons. In addition to the provisions set out in Regulations (EU) 2016/679 and (EU) 2018/1725, Directive (EU) 2016/680 and Regulation , all the following conditions must be met in order for such Error! Post not found for word:processing to occur:
(a) the bias detection and correction cannot be effectively fulfilled by Error! Post not found for word:processing other Error! Post not found for word:data, including synthetic or anonymised Error! Post not found for word:data;
(b) the special categories of personal data are Error! Post not found for word:subject to technical limitations on the re-use of the Error! Post not found for word:personal Error! Post not found for word:data, and state-of-the-art security and privacy-preserving measures, including Error! Post not found for word:pseudonymisation;
(c) the special categories of personal data are Error! Post not found for word:subject to measures to ensure that the Error! Post not found for word:personal Error! Post not found for word:data processed are secured, protected, Error! Post not found for word:subject to suitable safeguards, including strict controls and documentation of the access, to avoid misuse and ensure that only authorised persons have access to those Error! Post not found for word:personal Error! Post not found for word:data with appropriate confidentiality obligations;
(d) the special categories of personal data are not to be transmitted, transferred or otherwise accessed by other parties;
(e) the special categories of personal data are deleted once the bias has been corrected or the Error! Post not found for word:personal Error! Post not found for word:data has reached the end of its retention period, whichever comes first;
(f) the records of Error! Post not found for word:processing activities pursuant to Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680 include the reasons why the Error! Post not found for word:processing of special categories of personal data was strictly necessary to detect and correct biases, and why that objective could not be achieved by Error! Post not found for word:processing other Error! Post not found for word:data.
- For the development of high-Error! Post not found for word:risk Error! Post not found for word:ai systems not using techniques involving the training of AI models, paragraphs 2 to 5 apply only to the Error! Post not found for word:testing Error! Post not found for word:data sets.
Article 11 – Technical documentation
- The technical documentation of a high-Error! Post not found for word:risk Error! Post not found for word:ai system shall be drawn up before that system is placed on the market or put into service and shall be kept up-to date.
The technical documentation shall be drawn up in such a way as to demonstrate that the high-Error! Post not found for word:risk Error! Post not found for word:ai system complies with the requirements set out in this Section and to provide national competent authorities and notified bodies with the necessary information in a clear and comprehensive form to assess the compliance of the Error! Post not found for word:ai system with those requirements. It shall contain, at a minimum, the elements set out in Annex IV. SMEs, including start-ups, may provide the elements of the technical documentation specified in Annex IV in a simplified manner. To that end, the Commission shall establish a simplified technical documentation form targeted at the needs of small and microenterprises. Where an SME, including a start-up, opts to provide the information required in Annex IV in a simplified manner, it shall use the form referred to in this paragraph. Notified bodies shall accept the form for the purposes of the conformity assessment.
- Where a high-Error! Post not found for word:risk Error! Post not found for word:ai system related to a product covered by the Union harmonisation legislation listed in Section A of Annex I is placed on the market or put into service, a single set of technical documentation shall be drawn up containing all the information set out in paragraph 1, as well as the information required under those legal acts.
- The Commission is empowered adopt delegated acts in accordance with Article 97 in order to amend Annex IV where necessary to ensure that, in light of technical progress, the technical documentation provides all the information necessary to assess the compliance of the system with the requirements set out in this Section.
Article 12 – Record-keeping
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall technically allow for the automatic recording of events (‘logs’) over the lifetime of the system.
- In order to ensure a level of traceability of the functioning of a high-Error! Post not found for word:risk Error! Post not found for word:ai system that is appropriate to the Error! Post not found for word:intended purpose of the system, logging capabilities shall enable the recording of events relevant for:
(a) identifying situations that may result in the high-Error! Post not found for word:risk Error! Post not found for word:ai system presenting a Error! Post not found for word:risk within the meaning of Article 79(1) or in a substantial modification;
(b) facilitating the post-market monitoring referred to in Article 72; and
(c) monitoring the operation of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Article 26(6).
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 1 (a) of Annex III, the logging capabilities shall provide, at a minimum:
(a) recording of the period of each use of the system (start date and time and end date and time of each use);
(b) the reference database against which Error! Post not found for word:input data has been checked by the system;
(c) the Error! Post not found for word:input data for which the search has led to a match;
(d) the identification of the natural persons involved in the verification of the results, as referred to in Article 14(5).
Article 13 – Transparency and provision of information to deployers
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be designed and developed in such a way as to ensure that their operation is sufficiently transparent to enable Error! Post not found for word:deployers to interpret a system’s output and use it appropriately. An appropriate type and degree of transparency shall be ensured with a view to achieving compliance with the relevant obligations of the Error! Post not found for word:provider and Error! Post not found for word:deployer set out in Section 3.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be accompanied by instructions for use in an appropriate digital format or otherwise that include concise, complete, correct and clear information that is relevant, accessible and comprehensible to Error! Post not found for word:deployers.
- The instructions for use shall contain at least the following information:
(a) the identity and the contact details of the Error! Post not found for word:provider and, where applicable, of its authorised representative;
(b) the characteristics, capabilities and limitations of performance of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, including:
(i) its Error! Post not found for word:intended purpose;
(ii) the level of Error! Post not found for word:accuracy, including its metrics, robustness and Error! Post not found for word:cybersecurity referred to in Article 15 against which the high-Error! Post not found for word:risk Error! Post not found for word:ai system has been tested and validated and which can be expected, and any known and foreseeable circumstances that may have an impact on that expected level of Error! Post not found for word:accuracy, robustness and Error! Post not found for word:cybersecurity;
(iii) any known or foreseeable circumstance, related to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with its Error! Post not found for word:intended purpose or under conditions of reasonably foreseeable misuse, which may lead to risks to the health and safety or fundamental rights referred to in Article 9(2);
(iv) where applicable, the technical capabilities and characteristics of the high-Error! Post not found for word:risk Error! Post not found for word:ai system to provide information that is relevant to explain its output;
(v) when appropriate, its performance regarding specific persons or groups of persons on which the system is intended to be used;
(vi) when appropriate, specifications for the Error! Post not found for word:input data, or any other relevant information in terms of the training, validation and Error! Post not found for word:testing Error! Post not found for word:data sets used, taking into account the Error! Post not found for word:intended purpose of the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(vii) where applicable, information to enable Error! Post not found for word:deployers to interpret the output of the high-Error! Post not found for word:risk Error! Post not found for word:ai system and use it appropriately;
(c) the changes to the high-Error! Post not found for word:risk Error! Post not found for word:ai system and its performance which have been pre-determined by the Error! Post not found for word:provider at the moment of the initial conformity assessment, if any;
(d) the human oversight measures referred to in Article 14, including the technical measures put in place to facilitate the interpretation of the outputs of the high-Error! Post not found for word:risk Error! Post not found for word:ai systems by the Error! Post not found for word:deployers;
(e) the computational and Error! Post not found for word:hardware resources needed, the expected lifetime of the high-Error! Post not found for word:risk Error! Post not found for word:ai system and any necessary maintenance and care measures, including their frequency, to ensure the proper functioning of that Error! Post not found for word:ai system, including as regards Error! Post not found for word:software updates;
(f) where relevant, a description of the mechanisms included within the high-Error! Post not found for word:risk Error! Post not found for word:ai system that allows Error! Post not found for word:deployers to properly collect, store and interpret the logs in accordance with Article 12.
Article 14 – Human oversight
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be designed and developed in such a way, including with appropriate human-machine interface tools, that they can be effectively overseen by natural persons during the period in which they are in use.
- Human oversight shall aim to prevent or minimise the risks to health, safety or fundamental rights that may emerge when a high-Error! Post not found for word:risk Error! Post not found for word:ai system is used in accordance with its Error! Post not found for word:intended purpose or under conditions of reasonably foreseeable misuse, in particular where such risks persist despite the application of other requirements set out in this Section.
- The oversight measures shall be commensurate with the risks, level of autonomy and context of use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, and shall be ensured through either one or both of the following types of measures:
(a) measures identified and built, when technically feasible, into the high-Error! Post not found for word:risk Error! Post not found for word:ai system by the Error! Post not found for word:provider before it is placed on the market or put into service;
(b) measures identified by the Error! Post not found for word:provider before placing the high-Error! Post not found for word:risk Error! Post not found for word:ai system on the market or putting it into service and that are appropriate to be implemented by the Error! Post not found for word:deployer.
- For the purpose of implementing paragraphs 1, 2 and 3, the high-Error! Post not found for word:risk Error! Post not found for word:ai system shall be provided to the Error! Post not found for word:deployer in such a way that natural persons to whom human oversight is assigned are enabled, as appropriate and proportionate:
(a) to properly understand the relevant capacities and limitations of the high-Error! Post not found for word:risk Error! Post not found for word:ai system and be able to duly monitor its operation, including in view of detecting and addressing anomalies, dysfunctions and unexpected performance;
(b) to remain aware of the possible tendency of automatically relying or over-relying on the output produced by a high-Error! Post not found for word:risk Error! Post not found for word:ai system (‘automation bias’), in particular for high-Error! Post not found for word:risk Error! Post not found for word:ai systems used to provide information or recommendations for decisions to be taken by natural persons;
(c) to correctly interpret the high-Error! Post not found for word:risk Error! Post not found for word:ai system’s output, taking into account, for example, the interpretation tools and methods available;
(d) to decide, in any particular situation, not to use the high-Error! Post not found for word:risk Error! Post not found for word:ai system or to otherwise disregard, override or reverse the output of the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(e) to intervene in the operation of the high-Error! Post not found for word:risk Error! Post not found for word:ai system or interrupt the system through a ‘stop’ button or a similar procedure that allows the system to come to a halt in a safe state.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 1(a) of Annex III, the measures referred to in paragraph 3 of this Article shall be such as to ensure that, in addition, no action or decision is taken by the Error! Post not found for word:deployer on the basis of the identification resulting from the system unless that identification has been separately verified and confirmed by at least two natural persons with the necessary competence, training and authority.
The requirement for a separate verification by at least two natural persons shall not apply to high-Error! Post not found for word:risk Error! Post not found for word:ai systems used for the purposes of Error! Post not found for word:law enforcement, migration, border control or asylum, where Union or national law considers the application of this requirement to be disproportionate.
Article 15 – Accuracy, robustness and cybersecurity
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be designed and developed in such a way that they achieve an appropriate level of Error! Post not found for word:accuracy, robustness, and Error! Post not found for word:cybersecurity, and that they perform consistently in those respects throughout their lifecycle.
- To address the technical aspects of how to measure the appropriate levels of Error! Post not found for word:accuracy and robustness set out in paragraph 1 and any other relevant performance metrics, the Commission shall, in cooperation with relevant stakeholders and organisations such as metrology and benchmarking authorities, encourage, as appropriate, the development of benchmarks and measurement methodologies.
- The levels of Error! Post not found for word:accuracy and the relevant Error! Post not found for word:accuracy metrics of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be declared in the accompanying instructions of use.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be as resilient as possible regarding errors, faults or inconsistencies that may occur within the system or the environment in which the system operates, in particular due to their interaction with natural persons or other systems. Technical and organisational measures shall be taken in this regard.
The robustness of high-Error! Post not found for word:risk Error! Post not found for word:ai systems may be achieved through technical redundancy solutions, which may include backup or fail-safe plans.
High-Error! Post not found for word:risk Error! Post not found for word:ai systems that continue to learn after being placed on the market or put into service shall be developed in such a way as to eliminate or reduce as far as possible the Error! Post not found for word:risk of possibly biased outputs influencing input for future operations (‘feedback loops’), and as to ensure that any such feedback loops are duly addressed with appropriate mitigation measures.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be resilient against attempts by unauthorised third parties to alter their use, outputs or performance by exploiting system vulnerabilities.
The technical solutions aiming to ensure the Error! Post not found for word:cybersecurity of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be appropriate to the relevant circumstances and the risks.
The technical solutions to address AI specific vulnerabilities shall include, where appropriate, measures to prevent, detect, respond to, resolve and control for attacks trying to manipulate the Error! Post not found for word:training Error! Post not found for word:data set (‘Error! Post not found for word:data poisoning’), or pre-trained components used in training (‘model poisoning’), inputs designed to cause the AI model to make a mistake (‘adversarial examples’ or ‘model evasion’), confidentiality attacks or model flaws.
Section 3 – Obligations of providers and deployers of high-risk AI systems and other parties
Article 16 – Obligations of providers of high-risk AI systems
Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall:
(a) ensure that their high-Error! Post not found for word:risk Error! Post not found for word:ai systems are compliant with the requirements set out in Section 2;
(b) indicate on the high-Error! Post not found for word:risk Error! Post not found for word:ai system or, where that is not possible, on its packaging or its accompanying documentation, as applicable their name, registered trade name or registered trade mark, the address at which they can be contacted;
(c) have a quality management system in place which complies with Article 17;
(d) keep the documentation referred to in Article 18;
(e) when under their control, keep the logs automatically generated by their high-Error! Post not found for word:risk Error! Post not found for word:ai systems as referred to in Article 19;
(f) ensure that the high-Error! Post not found for word:risk Error! Post not found for word:ai system undergoes the relevant conformity assessment procedure as referred to in Article 43, prior to its being placed on the market or put into service;
(g) draw up an EU declaration of conformity in accordance with Article 47;
(h) affix the Error! Post not found for word:ce marking to the high-Error! Post not found for word:risk Error! Post not found for word:ai system or, where that is not possible, on its packaging or its accompanying documentation, to indicate conformity with this Regulation, in accordance with Article 48;
(i) comply with the registration obligations referred to in Article 49(1);
(j) take the necessary corrective actions and provide information as required in Article 20;
(k) upon a reasoned request of a national competent authority, demonstrate the conformity of the high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Section 2;
(l) ensure that the high-Error! Post not found for word:risk Error! Post not found for word:ai system complies with accessibility requirements in accordance with Directives (EU) 2016/2102 and (EU) 2019/882.
Article 17 – Quality management system
- Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall put a quality management system in place that ensures compliance with this Regulation. That system shall be documented in a systematic and orderly manner in the form of written policies, procedures and instructions, and shall include at least the following aspects:
(a) a strategy for regulatory compliance, including compliance with conformity assessment procedures and procedures for the management of modifications to the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(b) techniques, procedures and systematic actions to be used for the design, design control and design verification of the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(c) techniques, procedures and systematic actions to be used for the development, quality control and quality assurance of the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(d) examination, test and validation procedures to be carried out before, during and after the development of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, and the frequency with which they have to be carried out;
(e) technical specifications, including standards, to be applied and, where the relevant harmonised standards are not applied in full or do not cover all of the relevant requirements set out in Section 2, the means to be used to ensure that the high-Error! Post not found for word:risk Error! Post not found for word:ai system complies with those requirements;
(f) systems and procedures for Error! Post not found for word:data management, including Error! Post not found for word:data acquisition, Error! Post not found for word:data collection, Error! Post not found for word:data analysis, Error! Post not found for word:data labelling, Error! Post not found for word:data storage, Error! Post not found for word:data filtration, Error! Post not found for word:data mining, Error! Post not found for word:data aggregation, Error! Post not found for word:data retention and any other operation regarding the Error! Post not found for word:data that is performed before and for the purpose of the placing on the market or the putting into service of high-Error! Post not found for word:risk Error! Post not found for word:ai systems;
(g) the Error! Post not found for word:risk management system referred to in Article 9;
(h) the setting-up, implementation and maintenance of a post-market monitoring system, in accordance with Article 72;
(i) procedures related to the reporting of a Error! Post not found for word:serious Error! Post not found for word:incident in accordance with Article 73;
(j) the handling of communication with national competent authorities, other relevant authorities, including those providing or supporting the access to Error! Post not found for word:data, notified bodies, other Error! Post not found for word:operators, customers or other interested parties;
(k) systems and procedures for record-keeping of all relevant documentation and information;
(l) resource management, including security-of-supply related measures;
(m) an Error! Post not found for word:accountability framework setting out the responsibilities of the management and other staff with regard to all the aspects listed in this paragraph.
- The implementation of the aspects referred to in paragraph 1 shall be proportionate to the size of the Error! Post not found for word:provider’s organisation. Error! Post not found for word:providers shall, in any event, respect the degree of rigour and the level of protection required to ensure the compliance of their high-Error! Post not found for word:risk Error! Post not found for word:ai systems with this Regulation.
- Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are Error! Post not found for word:subject to obligations regarding quality management systems or an equivalent function under relevant sectoral Union law may include the aspects listed in paragraph 1 as part of the quality management systems pursuant to that law.
- For Error! Post not found for word:providers that are financial institutions Error! Post not found for word:subject to requirements regarding their internal governance, arrangements or processes under Union financial services law, the obligation to put in place a quality management system, with the exception of paragraph 1, points (g), (h) and (i) of this Article, shall be deemed to be fulfilled by complying with the rules on internal governance arrangements or processes pursuant to the relevant Union financial services law. To that end, any harmonised standards referred to in Article 40 shall be taken into account.
Article 18 – Documentation keeping
- The Error! Post not found for word:provider shall, for a period ending 10 years after the high-Error! Post not found for word:risk Error! Post not found for word:ai system has been placed on the market or put into service, keep at the disposal of the national competent authorities:
(a) the technical documentation referred to in Article 11;
(b) the documentation concerning the quality management system referred to in Article 17;
(c) the documentation concerning the changes approved by notified bodies, where applicable;
(d) the decisions and other documents issued by the notified bodies, where applicable;
(e) the EU declaration of conformity referred to in Article 47.
- Each Member State shall determine conditions under which the documentation referred to in paragraph 1 remains at the disposal of the national competent authorities for the period indicated in that paragraph for the cases when a Error! Post not found for word:provider or its authorised representative established on its territory goes bankrupt or ceases its activity prior to the end of that period.
- Error! Post not found for word:providers that are financial institutions Error! Post not found for word:subject to requirements regarding their internal governance, arrangements or processes under Union financial services law shall maintain the technical documentation as part of the documentation kept under the relevant Union financial services law.
Article 19 – Automatically generated logs
- Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall keep the logs referred to in Article 12(1), automatically generated by their high-Error! Post not found for word:risk Error! Post not found for word:ai systems, to the extent such logs are under their control. Without prejudice to applicable Union or national law, the logs shall be kept for a period appropriate to the Error! Post not found for word:intended purpose of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, of at least six months, unless provided otherwise in the applicable Union or national law, in particular in Union law on the protection of Error! Post not found for word:personal Error! Post not found for word:data.
- Error! Post not found for word:providers that are financial institutions Error! Post not found for word:subject to requirements regarding their internal governance, arrangements or processes under Union financial services law shall maintain the logs automatically generated by their high-Error! Post not found for word:risk Error! Post not found for word:ai systems as part of the documentation kept under the relevant financial services law.
Article 20 – Corrective actions and duty of information
- Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems which consider or have reason to consider that a high-Error! Post not found for word:risk Error! Post not found for word:ai system that they have placed on the market or put into service is not in conformity with this Regulation shall immediately take the necessary corrective actions to bring that system into conformity, to withdraw it, to disable it, or to recall it, as appropriate. They shall inform the Error! Post not found for word:distributors of the high-Error! Post not found for word:risk Error! Post not found for word:ai system concerned and, where applicable, the Error! Post not found for word:deployers, the authorised representative and Error! Post not found for word:importers accordingly.
- Where the high-Error! Post not found for word:risk Error! Post not found for word:ai system presents a Error! Post not found for word:risk within the meaning of Article 79(1) and the Error! Post not found for word:provider becomes aware of that Error! Post not found for word:risk, it shall immediately investigate the causes, in collaboration with the reporting Error! Post not found for word:deployer, where applicable, and inform the market surveillance authorities competent for the high-Error! Post not found for word:risk Error! Post not found for word:ai system concerned and, where applicable, the Error! Post not found for word:notified body that issued a certificate for that high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with Article 44, in particular, of the nature of the non-compliance and of any relevant corrective action taken.
Article 21 – Cooperation with competent authorities
- Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall, upon a reasoned request by a competent authority, provide that authority all the information and documentation necessary to demonstrate the conformity of the high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Section 2, in a language which can be easily understood by the authority in one of the official languages of the institutions of the Union as indicated by the Member State concerned.
- Upon a reasoned request by a competent authority, Error! Post not found for word:providers shall also give the requesting competent authority, as applicable, access to the automatically generated logs of the high-Error! Post not found for word:risk Error! Post not found for word:ai system referred to in Article 12(1), to the extent such logs are under their control.
- Any information obtained by a competent authority pursuant to this Article shall be treated in accordance with the confidentiality obligations set out in Article 78.
Article 22 – Authorised representatives of providers of high-risk AI systems
- Prior to making their high-Error! Post not found for word:risk Error! Post not found for word:ai systems available on the Union market, Error! Post not found for word:providers established in third countries shall, by written mandate, appoint an authorised representative which is established in the Union.
- The Error! Post not found for word:provider shall enable its authorised representative to perform the tasks specified in the mandate received from the Error! Post not found for word:provider.
- The authorised representative shall perform the tasks specified in the mandate received from the Error! Post not found for word:provider. It shall provide a copy of the mandate to the market surveillance authorities upon request, in one of the official languages of the institutions of the Union, as indicated by the competent authority. For the purposes of this Regulation, the mandate shall empower the authorised representative to carry out the following tasks:
(a) verify that the EU declaration of conformity referred to in Article 47 and the technical documentation referred to in Article 11 have been drawn up and that an appropriate conformity assessment procedure has been carried out by the Error! Post not found for word:provider;
(b) keep at the disposal of the competent authorities and national authorities or bodies referred to in Article 74(10), for a period of 10 years after the high-Error! Post not found for word:risk Error! Post not found for word:ai system has been placed on the market or put into service, the contact details of the Error! Post not found for word:provider that appointed the authorised representative, a copy of the EU declaration of conformity referred to in Article 47, the technical documentation and, if applicable, the certificate issued by the Error! Post not found for word:notified body;
(c) provide a competent authority, upon a reasoned request, with all the information and documentation, including that referred to in point (b) of this subparagraph, necessary to demonstrate the conformity of a high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Section 2, including access to the logs, as referred to in Article 12(1), automatically generated by the high-Error! Post not found for word:risk Error! Post not found for word:ai system, to the extent such logs are under the control of the Error! Post not found for word:provider;
(d) cooperate with competent authorities, upon a reasoned request, in any action the latter take in relation to the high-Error! Post not found for word:risk Error! Post not found for word:ai system, in particular to reduce and mitigate the risks posed by the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(e) where applicable, comply with the registration obligations referred in Article 49(1), or, if the registration is carried out by the Error! Post not found for word:provider itself, ensure that the information referred to in point 3 of Section A of Annex VIII is correct.
The mandate shall empower the authorised representative to be addressed, in addition to or instead of the Error! Post not found for word:provider, by the competent authorities, on all issues related to ensuring compliance with this Regulation.
- The authorised representative shall terminate the mandate if it considers or has reason to consider the Error! Post not found for word:provider to be acting contrary to its obligations pursuant to this Regulation. In such a case, it shall immediately inform the relevant market surveillance authority, as well as, where applicable, the relevant Error! Post not found for word:notified body, about the termination of the mandate and the reasons therefor.
Article 23 – Obligations of importers
- Before placing a high-Error! Post not found for word:risk Error! Post not found for word:ai system on the market, Error! Post not found for word:importers shall ensure that the system is in conformity with this Regulation by verifying that:
(a) the relevant conformity assessment procedure referred to in Article 43 has been carried out by the Error! Post not found for word:provider of the high-Error! Post not found for word:risk Error! Post not found for word:ai system;
(b) the Error! Post not found for word:provider has drawn up the technical documentation in accordance with Article 11 and Annex IV;
(c) the system bears the required Error! Post not found for word:ce marking and is accompanied by the EU declaration of conformity referred to in Article 47 and instructions for use;
(d) the Error! Post not found for word:provider has appointed an authorised representative in accordance with Article 22(1).
- Where an Error! Post not found for word:importer has sufficient reason to consider that a high-Error! Post not found for word:risk Error! Post not found for word:ai system is not in conformity with this Regulation, or is falsified, or accompanied by falsified documentation, it shall not place the system on the market until it has been brought into conformity. Where the high-Error! Post not found for word:risk Error! Post not found for word:ai system presents a Error! Post not found for word:risk within the meaning of Article 79(1), the Error! Post not found for word:importer shall inform the Error! Post not found for word:provider of the system, the authorised representative and the market surveillance authorities to that effect.
- Error! Post not found for word:importers shall indicate their name, registered trade name or registered trade mark, and the address at which they can be contacted on the high-Error! Post not found for word:risk Error! Post not found for word:ai system and on its packaging or its accompanying documentation, where applicable.
- Error! Post not found for word:importers shall ensure that, while a high-Error! Post not found for word:risk Error! Post not found for word:ai system is under their responsibility, storage or transport conditions, where applicable, do not jeopardise its compliance with the requirements set out in Section 2.
- Error! Post not found for word:importers shall keep, for a period of 10 years after the high-Error! Post not found for word:risk Error! Post not found for word:ai system has been placed on the market or put into service, a copy of the certificate issued by the Error! Post not found for word:notified body, where applicable, of the instructions for use, and of the EU declaration of conformity referred to in Article 47.
- Error! Post not found for word:importers shall provide the relevant competent authorities, upon a reasoned request, with all the necessary information and documentation, including that referred to in paragraph 5, to demonstrate the conformity of a high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Section 2 in a language which can be easily understood by them. For this purpose, they shall also ensure that the technical documentation can be made available to those authorities.
- Error! Post not found for word:importers shall cooperate with the relevant competent authorities in any action those authorities take in relation to a high-Error! Post not found for word:risk Error! Post not found for word:ai system placed on the market b ythe Error! Post not found for word:importers, in particular to reduce and mitigate the risks posed by it.
Article 24 – Obligations of distributors
- Before making a high-Error! Post not found for word:risk Error! Post not found for word:ai system available on the market, Error! Post not found for word:distributors shall verify that it bears the required Error! Post not found for word:ce marking, that it is accompanied by a copy of the EU declaration of conformity referred to in Article 47 and instructions for use, and that the Error! Post not found for word:provider and the Error! Post not found for word:importer of that system, as applicable, have complied with their respective obligations as laid down in Article 16, points (b) and (c) and Article 23(3).
- Where a Error! Post not found for word:distributor considers or has reason to consider, on the basis of the information in its possession, that a high-Error! Post not found for word:risk Error! Post not found for word:ai system is not in conformity with the requirements set out in Section 2, it shall not make the high-Error! Post not found for word:risk Error! Post not found for word:ai system available on the market until the system has been brought into conformity with those requirements. Furthermore, where the high-Error! Post not found for word:risk Error! Post not found for word:ai system presents a Error! Post not found for word:risk within the meaning of Article 79(1), the Error! Post not found for word:distributor shall inform the Error! Post not found for word:provider or the Error! Post not found for word:importer of the system, as applicable, to that effect.
- Error! Post not found for word:distributors shall ensure that, while a high-Error! Post not found for word:risk Error! Post not found for word:ai system is under their responsibility storage or transport conditions, where applicable, do not jeopardise the compliance of the system with the requirements set out in Section 2.
- A Error! Post not found for word:distributor that considers or has reason to consider, on the basis of the information in its possession, a high-Error! Post not found for word:risk Error! Post not found for word:ai system which it has made available on the market not to be in conformity with the requirements set out in Section 2, shall take the corrective actions necessary to bring that system into conformity with those requirements, to withdraw it or recall it, or shall ensure that the Error! Post not found for word:provider, the Error! Post not found for word:importer or any relevant Error! Post not found for word:operator, as appropriate, takes those corrective actions. Where the high-Error! Post not found for word:risk Error! Post not found for word:ai system presents a Error! Post not found for word:risk within the meaning of Article 79(1), the Error! Post not found for word:distributor shall immediately inform the Error! Post not found for word:provider or Error! Post not found for word:importer of the system and the authorities competent for the high-Error! Post not found for word:risk Error! Post not found for word:ai system concerned, giving details, in particular, of the non-compliance and of any corrective actions taken.
- Upon a reasoned request from a relevant competent authority, Error! Post not found for word:distributors of a high-Error! Post not found for word:risk Error! Post not found for word:ai system shall provide that authority with all the information and documentation regarding their actions pursuant to paragraphs 1 to 4 necessary to demonstrate the conformity of that system with the requirements set out in Section 2.
- Error! Post not found for word:distributors shall cooperate with the relevant competent authorities in any action those authorities take in relation to a high-Error! Post not found for word:risk Error! Post not found for word:ai system made available on the market by the Error! Post not found for word:distributors, in particular to reduce or mitigate the Error! Post not found for word:risk posed by it.
Article 25 – Responsibilities along the AI value chain
- Any Error! Post not found for word:distributor, Error! Post not found for word:importer, Error! Post not found for word:deployer or other third-party shall be considered to be a Error! Post not found for word:provider of a high-Error! Post not found for word:risk Error! Post not found for word:ai system for the purposes of this Regulation and shall be Error! Post not found for word:subject to the obligations of the Error! Post not found for word:provider under Article 16, in any of the following circumstances:
(a) they put their name or trademark on a high-Error! Post not found for word:risk Error! Post not found for word:ai system already placed on the market or put into service, without prejudice to contractual arrangements stipulating that the obligations are otherwise allocated;
(b) they make a substantial modification to a high-Error! Post not found for word:risk Error! Post not found for word:ai system that has already been placed on the market or has already been put into service in such a way that it remains a high-Error! Post not found for word:risk Error! Post not found for word:ai system pursuant to Article 6;
(c) they modify the Error! Post not found for word:intended purpose of an Error! Post not found for word:ai system, including a general-purpose AI system, which has not been classified as high-Error! Post not found for word:risk and has already been placed on the market or put into service in such a way that the Error! Post not found for word:ai system concerned becomes a high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with Article 6.
- Where the circumstances referred to in paragraph 1 occur, the Error! Post not found for word:provider that initially placed the Error! Post not found for word:ai system on the market or put it into service shall no longer be considered to be a Error! Post not found for word:provider of that specific Error! Post not found for word:ai system for the purposes of this Regulation. That initial Error! Post not found for word:provider shall closely cooperate with new Error! Post not found for word:providers and shall make available the necessary information and provide the reasonably expected technical access and other assistance that are required for the fulfilment of the obligations set out in this Regulation, in particular regarding the compliance with the conformity assessment of high-Error! Post not found for word:risk Error! Post not found for word:ai systems. This paragraph shall not apply in cases where the initial Error! Post not found for word:provider has clearly specified that its Error! Post not found for word:ai system is not to be changed into a high-Error! Post not found for word:risk Error! Post not found for word:ai system and therefore does not fall under the obligation to hand over the documentation.
- In the case of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are safety components of products covered by the Union harmonisation legislation listed in Section A of Annex I, the product Error! Post not found for word:manufacturer shall be considered to be the Error! Post not found for word:provider of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, and shall be Error! Post not found for word:subject to the obligations under Article 16 under either of the following circumstances:
(a) the high-Error! Post not found for word:risk Error! Post not found for word:ai system is placed on the market together with the product under the name or trademark of the product Error! Post not found for word:manufacturer;
(b) the high-Error! Post not found for word:risk Error! Post not found for word:ai system is put into service under the name or trademark of the product Error! Post not found for word:manufacturer after the product has been placed on the market.
- The Error! Post not found for word:provider of a high-Error! Post not found for word:risk Error! Post not found for word:ai system and the Error! Post not found for word:third party that supplies an Error! Post not found for word:ai system, tools, services, components, or processes that are used or integrated in a high-Error! Post not found for word:risk Error! Post not found for word:ai system shall, by written agreement, specify the necessary information, capabilities, technical access and other assistance based on the generally acknowledged state of the art, in order to enable the Error! Post not found for word:provider of the high-Error! Post not found for word:risk Error! Post not found for word:ai system to fully comply with the obligations set out in this Regulation. This paragraph shall not apply to third parties making accessible to the public tools, services, processes, or components, other than general-purpose AI models, under a free and open-source licence.
The Error! Post not found for word:ai office may develop and recommend voluntary model terms for contracts between Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems and third parties that supply tools, services, components or processes that are used for or integrated into high-Error! Post not found for word:risk Error! Post not found for word:ai systems. When developing those voluntary model terms, the Error! Post not found for word:ai office shall take into account possible contractual requirements applicable in specific sectors or business cases. The voluntary model terms shall be published and be available free of charge in an easily usable electronic format.
- Paragraphs 2 and 3 are without prejudice to the need to observe and protect intellectual property rights, confidential business information and trade secrets in accordance with Union and national law.
Article 26 – Obligations of deployers of high-risk AI systems
- Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall take appropriate technical and organisational measures to ensure they use such systems in accordance with the instructions for use accompanying the systems, pursuant to paragraphs 3 and 6.
- Error! Post not found for word:deployers shall assign human oversight to natural persons who have the necessary competence, training and authority, as well as the necessary support.
- The obligations set out in paragraphs 1 and 2, are without prejudice to other Error! Post not found for word:deployer obligations under Union or national law and to the Error! Post not found for word:deployer’s freedom to organise its own resources and activities for the purpose of implementing the human oversight measures indicated by the Error! Post not found for word:provider.
- Without prejudice to paragraphs 1 and 2, to the extent the Error! Post not found for word:deployer exercises control over the Error! Post not found for word:input data, that Error! Post not found for word:deployer shall ensure that Error! Post not found for word:input data is relevant and sufficiently representative in view of the Error! Post not found for word:intended purpose of the high-Error! Post not found for word:risk Error! Post not found for word:ai system.
- Error! Post not found for word:deployers shall monitor the operation of the high-Error! Post not found for word:risk Error! Post not found for word:ai system on the basis of the instructions for use and, where relevant, inform Error! Post not found for word:providers in accordance with Article 72. Where Error! Post not found for word:deployers have reason to consider that the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system in accordance with the instructions may result in that Error! Post not found for word:ai system presenting a Error! Post not found for word:risk within the meaning of Article 79(1), they shall, without undue delay, inform the Error! Post not found for word:provider or Error! Post not found for word:distributor and the relevant market surveillance authority, and shall suspend the use of that system. Where Error! Post not found for word:deployers have identified a Error! Post not found for word:serious Error! Post not found for word:incident, they shall also immediately inform first the Error! Post not found for word:provider, and then the Error! Post not found for word:importer or Error! Post not found for word:distributor and the relevant market surveillance authorities of that Error! Post not found for word:incident. If the Error! Post not found for word:deployer is not able to reach the Error! Post not found for word:provider, Article 73 shall apply mutatis mutandis. This obligation shall not cover sensitive operational data of Error! Post not found for word:deployers of Error! Post not found for word:ai systems which are Error! Post not found for word:law enforcement authorities.
For Error! Post not found for word:deployers that are financial institutions Error! Post not found for word:subject to requirements regarding their internal governance, arrangements or processes under Union financial services law, the monitoring obligation set out in the first subparagraph shall be deemed to be fulfilled by complying with the rules on internal governance arrangements, processes and mechanisms pursuant to the relevant financial service law.
- Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall keep the logs automatically generated by that high-Error! Post not found for word:risk Error! Post not found for word:ai system to the extent such logs are under their control, for a period appropriate to the Error! Post not found for word:intended purpose of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, of at least six months, unless provided otherwise in applicable Union or national law, in particular in Union law on the protection of Error! Post not found for word:personal Error! Post not found for word:data.
Error! Post not found for word:deployers that are financial institutions Error! Post not found for word:subject to requirements regarding their internal governance, arrangements or processes under Union financial services law shall maintain the logs as part of the documentation kept pursuant to the relevant Union financial service law.
- Before putting into service or using a high-Error! Post not found for word:risk Error! Post not found for word:ai system at the workplace, Error! Post not found for word:deployers who are employers shall inform workers’ Error! Post not found for word:representatives and the affected workers that they will be Error! Post not found for word:subject to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system. This information shall be provided, where applicable, in accordance with the rules and procedures laid down in Union and national law and practice on information of workers and their Error! Post not found for word:representatives.
- Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are public authorities, or Union institutions, bodies, offices or agencies shall comply with the registration obligations referred to in Article 49. When such Error! Post not found for word:deployers find that the high-Error! Post not found for word:risk Error! Post not found for word:ai system that they envisage using has not been registered in the EU database referred to in Article 71, they shall not use that system and shall inform the Error! Post not found for word:provider or the Error! Post not found for word:distributor.
- Where applicable, Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall use the information provided under Article 13 of this Regulation to comply with their obligation to carry out a data protection impact assessment under Article 35 of Regulation (EU) 2016/679 or Article 27 of Directive (EU) 2016/680.
- Without prejudice to Directive (EU) 2016/680, in the framework of an investigation for the targeted search of a person suspected or convicted of having committed a criminal offence, the Error! Post not found for word:deployer of a high-Error! Post not found for word:risk Error! Post not found for word:ai system for post-remote biometric identification shall request an authorisation, ex ante, or without undue delay and no later than 48 hours, by a judicial authority or an administrative authority whose decision is binding and Error! Post not found for word:subject to judicial review, for the use of that system, except when it is used for the initial identification of a potential suspect based on objective and verifiable facts directly linked to the offence. Each use shall be limited to what is strictly necessary for the investigation of a specific criminal offence.
If the authorisation requested pursuant to the first subparagraph is rejected, the use of the post-remote biometric identification system linked to that requested authorisation shall be stopped with immediate effect and the Error! Post not found for word:personal Error! Post not found for word:data linked to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system for which the authorisation was requested shall be deleted.
In no case shall such high-Error! Post not found for word:risk Error! Post not found for word:ai system for post-remote biometric identification be used for Error! Post not found for word:law enforcement purposes in an untargeted way, without any link to a criminal offence, a criminal proceeding, a genuine and present or genuine and foreseeable threat of a criminal offence, or the search for a specific missing person. It shall be ensured that no decision that produces an adverse legal effect on a person may be taken by the Error! Post not found for word:law enforcement authorities based solely on the output of such post-remote biometric identification systems.
This paragraph is without prejudice to Article 9 of Regulation (EU) 2016/679 and Article 10 of Directive (EU) 2016/680 for the Error! Post not found for word:processing of Error! Post not found for word:biometric Error! Post not found for word:data.
Regardless of the purpose or Error! Post not found for word:deployer, each use of such high-Error! Post not found for word:risk Error! Post not found for word:ai systems shall be documented in the relevant police file and shall be made available to the relevant market surveillance authority and the national Error! Post not found for word:data protection authority upon request, excluding the disclosure of sensitive operational data related to Error! Post not found for word:law enforcement. This subparagraph shall be without prejudice to the powers conferred by Directive (EU) 2016/680 on supervisory authorities.
Error! Post not found for word:deployers shall submit annual reports to the relevant market surveillance and national Error! Post not found for word:data protection authorities on their use of post-remote biometric identification systems, excluding the disclosure of sensitive operational data related to Error! Post not found for word:law enforcement. The reports may be aggregated to cover more than one deployment.
Member States may introduce, in accordance with Union law, more restrictive laws on the use of post-remote biometric identification systems.
- Without prejudice to Article 50 of this Regulation, Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Annex III that make decisions or assist in making decisions related to natural persons shall inform the natural persons that they are Error! Post not found for word:subject to the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system. For high-Error! Post not found for word:risk Error! Post not found for word:ai systems used for Error! Post not found for word:law enforcement purposes Article 13 of Directive (EU) 2016/680 shall apply.
- Error! Post not found for word:deployers shall cooperate with the relevant competent authorities in any action those authorities take in relation to the high-Error! Post not found for word:risk Error! Post not found for word:ai system in order to implement this Regulation.
Article 27 – Fundamental rights impact assessment for high-risk AI systems
- Prior to deploying a high-Error! Post not found for word:risk Error! Post not found for word:ai system referred to in Article 6(2), with the exception of high-Error! Post not found for word:risk Error! Post not found for word:ai systems intended to be used in the area listed in point 2 of Annex III, Error! Post not found for word:deployers that are bodies governed by public law, or are private entities providing public services, and Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in points 5 (b) and (c) of Annex III, shall perform an assessment of the impact on fundamental rights that the use of such system may produce. For that purpose, Error! Post not found for word:deployers shall perform an assessment consisting of:
(a) a description of the Error! Post not found for word:deployer’s processes in which the high-Error! Post not found for word:risk Error! Post not found for word:ai system will be used in line with its Error! Post not found for word:intended purpose;
(b) a description of the period of time within which, and the frequency with which, each high-Error! Post not found for word:risk Error! Post not found for word:ai system is intended to be used;
(c) the categories of natural persons and groups likely to be affected by its use in the specific context;
(d) the specific risks of harm likely to have an impact on the categories of natural persons or groups of persons identified pursuant to point (c) of this paragraph, taking into account the information given by the Error! Post not found for word:provider pursuant to Article 13;
(e) a description of the implementation of human oversight measures, according to the instructions for use;
(f) the measures to be taken in the case of materialisation of those risks, including the arrangements for internal governance and complaint mechanisms.
- The obligation laid down in paragraph 1 applies to the first use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system. The Error! Post not found for word:deployer may, in similar cases, rely on previously conducted fundamental rights impact assessments or existing impact assessments carried out by Error! Post not found for word:provider. If, during the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, the Error! Post not found for word:deployer considers that any of the elements listed in paragraph 1 has changed or is no longer up to date, the Error! Post not found for word:deployer shall take the necessary steps to update the information.
- Once the assessment referred to in paragraph 1 of this Article has been performed, the Error! Post not found for word:deployer shall notify the market surveillance authority of its results, submitting the filled-out template referred to in paragraph 5 of this Article as part of the notification. In the case referred to in Article 46(1), Error! Post not found for word:deployers may be exempt from that obligation to notify.
- If any of the obligations laid down in this Article is already met through the data protection impact assessment conducted pursuant to Article 35 of Regulation (EU) 2016/679 or Article 27 of Directive (EU) 2016/680, the fundamental rights impact assessment referred to in paragraph 1 of this Article shall complement that data protection impact assessment.
- The Error! Post not found for word:ai office shall develop a template for a questionnaire, including through an automated tool, to facilitate Error! Post not found for word:deployers in complying with their obligations under this Article in a simplified manner.
Section 4 – Notifying authorities and notified bodies
Article 28 – Notifying authorities
- Each Member State shall designate or establish at least one notifying authority responsible for setting up and carrying out the necessary procedures for the assessment, designation and notification of conformity assessment bodies and for their monitoring. Those procedures shall be developed in cooperation between the notifying authorities of all Member States.
- Member States may decide that the assessment and monitoring referred to in paragraph 1 is to be carried out by a national accreditation body within the meaning of, and in accordance with, Regulation (EC) No 765/2008.
- Notifying authorities shall be established, organised and operated in such a way that no conflict of interest arises with conformity assessment bodies, and that the objectivity and impartiality of their activities are safeguarded.
- Notifying authorities shall be organised in such a way that decisions relating to the notification of conformity assessment bodies are taken by competent persons different from those who carried out the assessment of those bodies.
- Notifying authorities shall offer or provide neither any activities that conformity assessment bodies perform, nor any consultancy services on a commercial or competitive basis.
- Notifying authorities shall safeguard the confidentiality of the information that they obtain, in accordance with Article 78.
- Notifying authorities shall have an adequate number of competent personnel at their disposal for the proper performance of their tasks. Competent personnel shall have the necessary expertise, where applicable, for their function, in fields such as information technologies, AI and law, including the supervision of fundamental rights.
Article 29 – Application of a conformity assessment body for notification
- Conformity assessment bodies shall submit an application for notification to the notifying authority of the Member State in which they are established.
- The application for notification shall be accompanied by a description of the conformity assessment activities, the conformity assessment module or modules and the types of Error! Post not found for word:ai systems for which the conformity assessment body claims to be competent, as well as by an accreditation certificate, where one exists, issued by a national accreditation body attesting that the conformity assessment body fulfils the requirements laid down in Article 31.
Any valid document related to existing designations of the applicant Error! Post not found for word:notified body under any other Union harmonisation legislation shall be added.
- Where the conformity assessment body concerned cannot provide an accreditation certificate, it shall provide the notifying authority with all the documentary evidence necessary for the verification, recognition and regular monitoring of its compliance with the requirements laid down in Article 31.
- For notified bodies which are designated under any other Union harmonisation legislation, all documents and certificates linked to those designations may be used to support their designation procedure under this Regulation, as appropriate. The Error! Post not found for word:notified body shall update the documentation referred to in paragraphs 2 and 3 of this Article whenever relevant changes occur, in order to enable the authority responsible for notified bodies to monitor and verify continuous compliance with all the requirements laid down in Article 31.
Article 30 – Notification procedure
- Notifying authorities may notify only conformity assessment bodies which have satisfied the requirements laid down in Article 31.
- Notifying authorities shall notify the Commission and the other Member States, using the electronic notification tool developed and managed by the Commission, of each conformity assessment body referred to in paragraph 1.
- The notification referred to in paragraph 2 of this Article shall include full details of the conformity assessment activities, the conformity assessment module or modules, the types of Error! Post not found for word:ai systems concerned, and the relevant attestation of competence. Where a notification is not based on an accreditation certificate as referred to in Article 29(2), the notifying authority shall provide the Commission and the other Member States with documentary evidence which attests to the competence of the conformity assessment body and to the arrangements in place to ensure that that body will be monitored regularly and will continue to satisfy the requirements laid down in Article 31.
- The conformity assessment body concerned may perform the activities of a Error! Post not found for word:notified body only where no objections are raised by the Commission or the other Member States within two weeks of a notification by a notifying authority where it includes an accreditation certificate referred to in Article 29(2), or within two months of a notification by the notifying authority where it includes documentary evidence referred to in Article 29(3).
- Where objections are raised, the Commission shall, without delay, enter into consultations with the relevant Member States and the conformity assessment body. In view thereof, the Commission shall decide whether the authorisation is justified. The Commission shall address its decision to the Member State concerned and to the relevant conformity assessment body.
Article 31 – Requirements relating to notified bodies
- A Error! Post not found for word:notified body shall be established under the national law of a Member State and shall have legal personality.
- Notified bodies shall satisfy the organisational, quality management, resources and process requirements that are necessary to fulfil their tasks, as well as suitable Error! Post not found for word:cybersecurity requirements.
- The organisational structure, allocation of responsibilities, reporting lines and operation of notified bodies shall ensure confidence in their performance, and in the results of the conformity assessment activities that the notified bodies conduct.
- Notified bodies shall be independent of the Error! Post not found for word:provider of a high-Error! Post not found for word:risk Error! Post not found for word:ai system in relation to which they perform conformity assessment activities. Notified bodies shall also be independent of any other Error! Post not found for word:operator having an economic interest in high-Error! Post not found for word:risk Error! Post not found for word:ai systems assessed, as well as of any competitors of the Error! Post not found for word:provider. This shall not preclude the use of assessed high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are necessary for the operations of the conformity assessment body, or the use of such high-Error! Post not found for word:risk Error! Post not found for word:ai systems for personal purposes.
- Neither a conformity assessment body, its top-level management nor the personnel responsible for carrying out its conformity assessment tasks shall be directly involved in the design, development, marketing or use of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, nor shall they represent the parties engaged in those activities. They shall not engage in any activity that might conflict with their independence of judgement or integrity in relation to conformity assessment activities for which they are notified. This shall, in particular, apply to consultancy services.
- Notified bodies shall be organised and operated so as to safeguard the independence, objectivity and impartiality of their activities. Notified bodies shall document and implement a structure and procedures to safeguard impartiality and to promote and apply the principles of impartiality throughout their organisation, personnel and assessment activities.
- Notified bodies shall have documented procedures in place ensuring that their personnel, committees, subsidiaries, subcontractors and any associated body or personnel of external bodies maintain, in accordance with Article 78, the confidentiality of the information which comes into their possession during the performance of conformity assessment activities, except when its disclosure is required by law. The staff of notified bodies shall be bound to observe professional secrecy with regard to all information obtained in carrying out their tasks under this Regulation, except in relation to the notifying authorities of the Member State in which their activities are carried out.
- Notified bodies shall have procedures for the performance of activities which take due account of the size of a Error! Post not found for word:provider, the sector in which it operates, its structure, and the degree of complexity of the Error! Post not found for word:ai system concerned.
- Notified bodies shall take out appropriate liability insurance for their conformity assessment activities, unless liability is assumed by the Member State in which they are established in accordance with national law or that Member State is itself directly responsible for the conformity assessment.
- Notified bodies shall be capable of carrying out all their tasks under this Regulation with the highest degree of professional integrity and the requisite competence in the specific field, whether those tasks are carried out by notified bodies themselves or on their behalf and under their responsibility.
- Notified bodies shall have sufficient internal competences to be able effectively to evaluate the tasks conducted by external parties on their behalf. The Error! Post not found for word:notified body shall have permanent Error! Post not found for word:availability of sufficient administrative, technical, legal and scientific personnel who possess experience and knowledge relating to the relevant types of Error! Post not found for word:ai systems, Error! Post not found for word:data and Error! Post not found for word:data computing, and relating to the requirements set out in Section 2.
- Notified bodies shall participate in coordination activities as referred to in Article 38. They shall also take part directly, or be represented in, European standardisation organisations, or ensure that they are aware and up to date in respect of relevant standards.
Article 32 – Presumption of conformity with requirements relating to notified bodies
Where a conformity assessment body demonstrates its conformity with the criteria laid down in the relevant harmonised standards or parts thereof, the references of which have been published in the Official Journal of the European Union, it shall be presumed to comply with the requirements set out in Article 31 in so far as the applicable harmonised standards cover those requirements.
Article 33 – Subsidiaries of notified bodies and subcontracting
- Where a Error! Post not found for word:notified body subcontracts specific tasks connected with the conformity assessment or has recourse to a subsidiary, it shall ensure that the subcontractor or the subsidiary meets the requirements laid down in Article 31, and shall inform the notifying authority accordingly.
- Notified bodies shall take full responsibility for the tasks performed by any subcontractors or subsidiaries.
- Activities may be subcontracted or carried out by a subsidiary only with the agreement of the Error! Post not found for word:provider. Notified bodies shall make a list of their subsidiaries publicly available.
- The relevant documents concerning the assessment of the qualifications of the subcontractor or the subsidiary and the work carried out by them under this Regulation shall be kept at the disposal of the notifying authority for a period of five years from the termination date of the subcontracting.
Article 34 – Operational obligations of notified bodies
- Notified bodies shall verify the conformity of high-Error! Post not found for word:risk Error! Post not found for word:ai systems in accordance with the conformity assessment procedures set out in Article 43.
- Notified bodies shall avoid unnecessary burdens for Error! Post not found for word:providers when performing their activities, and take due account of the size of the Error! Post not found for word:provider, the sector in which it operates, its structure and the degree of complexity of the high-Error! Post not found for word:risk Error! Post not found for word:ai system concerned, in particular in view of minimising administrative burdens and compliance costs for micro- and small enterprises within the meaning of Recommendation 2003/361/EC. The Error! Post not found for word:notified body shall, nevertheless, respect the degree of rigour and the level of protection required for the compliance of the high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements of this Regulation. .
- Notified bodies shall make available and submit upon request all relevant documentation, including the Error! Post not found for word:providers’ documentation, to the notifying authority referred to in Article 28 to allow that authority to conduct its assessment, designation, notification and monitoring activities, and to facilitate the assessment outlined in this Section.
Article 35 – Identification numbers and lists of notified bodies
- The Commission shall assign a single identification number to each Error! Post not found for word:notified body, even where a body is notified under more than one Union act.
- The Commission shall make publicly available the list of the bodies notified under this Regulation, including their identification numbers and the activities for which they have been notified. The Commission shall ensure that the list is kept up to date.
Article 36 – Changes to notifications
- The notifying authority shall notify the Commission and the other Member States of any relevant changes to the notification of a Error! Post not found for word:notified body via the electronic notification tool referred to in Article 30(2).
- The procedures laid down in Articles 29 and 30 shall apply to extensions of the scope of the notification.
For changes to the notification other than extensions of its scope, the procedures laid down in paragraphs (3) to (9) shall apply.
- Where a Error! Post not found for word:notified body decides to cease its conformity assessment activities, it shall inform the notifying authority and the Error! Post not found for word:providers concerned as soon as possible and, in the case of a planned cessation, at least one year before ceasing its activities. The certificates of the Error! Post not found for word:notified body may remain valid for a period of nine months after cessation of the Error! Post not found for word:notified body’s activities, on condition that another Error! Post not found for word:notified body has confirmed in writing that it will assume responsibilities for the high-Error! Post not found for word:risk Error! Post not found for word:ai systems covered by those certificates. The latter Error! Post not found for word:notified body shall complete a full assessment of the high-Error! Post not found for word:risk Error! Post not found for word:ai systems affected by the end of that nine-month-period before issuing new certificates for those systems. Where the Error! Post not found for word:notified body has ceased its activity, the notifying authority shall withdraw the designation.
- Where a notifying authority has sufficient reason to consider that a Error! Post not found for word:notified body no longer meets the requirements laid down in Article 31, or that it is failing to fulfil its obligations, the notifying authority shall without delay investigate the matter with the utmost diligence. In that context, it shall inform the Error! Post not found for word:notified body concerned about the objections raised and give it the possibility to make its views known. If the notifying authority comes to the conclusion that the Error! Post not found for word:notified body no longer meets the requirements laid down in Article 31 or that it is failing to fulfil its obligations, it shall restrict, suspend or withdraw the designation as appropriate, depending on the seriousness of the failure to meet those requirements or fulfil those obligations. It shall immediately inform the Commission and the other Member States accordingly.
- Where its designation has been suspended, restricted, or fully or partially withdrawn, the Error! Post not found for word:notified body shall inform the Error! Post not found for word:providers concerned within 10 days.
- In the event of the restriction, suspension or withdrawal of a designation, the notifying authority shall take appropriate steps to ensure that the files of the Error! Post not found for word:notified body concerned are kept, and to make them available to notifying authorities in other Member States and to market surveillance authorities at their request.
- In the event of the restriction, suspension or withdrawal of a designation, the notifying authority shall:
(a) assess the impact on the certificates issued by the Error! Post not found for word:notified body;
(b) submit a report on its findings to the Commission and the other Member States within three months of having notified the changes to the designation;
(c) require the Error! Post not found for word:notified body to suspend or withdraw, within a reasonable period of time determined by the authority, any certificates which were unduly issued, in order to ensure the continuing conformity of high-Error! Post not found for word:risk Error! Post not found for word:ai systems on the market;
(d) inform the Commission and the Member States about certificates the suspension or withdrawal of which it has required;
(e) provide the national competent authorities of the Member State in which the Error! Post not found for word:provider has its registered place of business with all relevant information about the certificates of which it has required the suspension or withdrawal; that authority shall take the appropriate measures, where necessary, to avoid a potential Error! Post not found for word:risk to health, safety or fundamental rights.
- With the exception of certificates unduly issued, and where a designation has been suspended or restricted, the certificates shall remain valid in one of the following circumstances:
(a) the notifying authority has confirmed, within one month of the suspension or restriction, that there is no Error! Post not found for word:risk to health, safety or fundamental rights in relation to certificates affected by the suspension or restriction, and the notifying authority has outlined a timeline for actions to remedy the suspension or restriction; or
(b) the notifying authority has confirmed that no certificates relevant to the suspension will be issued, amended or re-issued during the course of the suspension or restriction, and states whether the Error! Post not found for word:notified body has the capability of continuing to monitor and remain responsible for existing certificates issued for the period of the suspension or restriction; in the event that the notifying authority determines that the Error! Post not found for word:notified body does not have the capability to support existing certificates issued, the Error! Post not found for word:provider of the system covered by the certificate shall confirm in writing to the national competent authorities of the Member State in which it has its registered place of business, within three months of the suspension or restriction, that another qualified Error! Post not found for word:notified body is temporarily assuming the functions of the Error! Post not found for word:notified body to monitor and remain responsible for the certificates during the period of suspension or restriction.
- With the exception of certificates unduly issued, and where a designation has been withdrawn, the certificates shall remain valid for a period of nine months under the following circumstances:
(a) the national competent authority of the Member State in which the Error! Post not found for word:provider of the high-Error! Post not found for word:risk Error! Post not found for word:ai system covered by the certificate has its registered place of business has confirmed that there is no Error! Post not found for word:risk to health, safety or fundamental rights associated with the high-Error! Post not found for word:risk Error! Post not found for word:ai systems concerned; and
(b) another Error! Post not found for word:notified body has confirmed in writing that it will assume immediate responsibility for those Error! Post not found for word:ai systems and completes its assessment within 12 months of the withdrawal of the designation.
In the circumstances referred to in the first subparagraph, the national competent authority of the Member State in which the Error! Post not found for word:provider of the system covered by the certificate has its place of business may extend the provisional validity of the certificates for additional periods of three months, which shall not exceed 12 months in total.
The national competent authority or the Error! Post not found for word:notified body assuming the functions of the Error! Post not found for word:notified body affected by the change of designation shall immediately inform the Commission, the other Member States and the other notified bodies thereof.
Article 37 – Challenge to the competence of notified bodies
- The Commission shall, where necessary, investigate all cases where there are reasons to doubt the competence of a Error! Post not found for word:notified body or the continued fulfilment by a Error! Post not found for word:notified body of the requirements laid down in Article 31 and of its applicable responsibilities.
- The notifying authority shall provide the Commission, on request, with all relevant information relating to the notification or the maintenance of the competence of the Error! Post not found for word:notified body concerned.
- The Commission shall ensure that all sensitive information obtained in the course of its investigations pursuant to this Article is treated confidentially in accordance with Article 78.
- Where the Commission ascertains that a Error! Post not found for word:notified body does not meet or no longer meets the requirements for its notification, it shall inform the notifying Member State accordingly and request it to take the necessary corrective measures, including the suspension or withdrawal of the notification if necessary. Where the Member State fails to take the necessary corrective measures, the Commission may, by means of an implementing act, suspend, restrict or withdraw the designation. That implementing act shall be adopted in accordance with the examination procedure referred to in Article 98(2).
Article 38 – Coordination of notified bodies
- The Commission shall ensure that, with regard to high-Error! Post not found for word:risk Error! Post not found for word:ai systems, appropriate coordination and cooperation between notified bodies active in the conformity assessment procedures pursuant to this Regulation are put in place and properly operated in the form of a sectoral group of notified bodies.
- Each notifying authority shall ensure that the bodies notified by it participate in the work of a group referred to in paragraph 1, directly or through designated Error! Post not found for word:representatives.
- The Commission shall provide for the exchange of knowledge and best practices between notifying authorities.
Article 39 – Conformity assessment bodies of third countries
Conformity assessment bodies established under the law of a third country with which the Union has concluded an agreement may be authorised to carry out the activities of notified bodies under this Regulation, provided that they meet the requirements laid down in Article 31 or they ensure an equivalent level of compliance.
Section 5 – Standards, conformity assessment, certificates, registration
Article 40 – Harmonised standards and standardisation deliverables
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems or general-purpose AI models which are in conformity with harmonised standards or parts thereof the references of which have been published in the Official Journal of the European Union in accordance with Regulation (EU) No 1025/2012 shall be presumed to be in conformity with the requirements set out in Section 2 of this Chapter or, as applicable, with the obligations set out in of Chapter V, Sections 2 and 3, of this Regulation, to the extent that those standards cover those requirements or obligations.
- In accordance with Article 10 of Regulation (EU) No 1025/2012, the Commission shall issue, without undue delay, standardisation requests covering all requirements set out in Section 2 of this Chapter and, as applicable, standardisation requests covering obligations set out in Chapter V, Section 2 and 3 of this Regulation. The standardisation request shall also ask for deliverables on reporting and documentation processes to improve Error! Post not found for word:ai systems’ resource performance, such as reducing the high-Error! Post not found for word:risk Error! Post not found for word:ai system’s consumption of energy and of other resources during its lifecycle, and on the energy-efficient development of general-purpose AI models. When preparing a standardisation request, the Commission shall consult the Board and relevant stakeholders, including the advisory forum.
When issuing a standardisation request to European standardisation organisations, the Commission shall specify that standards have to be clear, consistent, including with the standards developed in the various sectors for products covered by the existing Union harmonisation legislation listed in Annex I, and aiming to ensure that high-Error! Post not found for word:risk Error! Post not found for word:ai systems or general-purpose AI models placed on the market or put into service in the Union meet the relevant or obligations requirements laid down in this Regulation.
The Commission shall request the European standardisation organisations to provide evidence of their best efforts to fulfil the objectives referred to in the first and the second subparagraph of this paragraph in accordance with Article 24 of Regulation (EU) No 1025/2012.
- The participants in the standardisation process shall seek to promote investment and innovation in AI, including through increasing legal certainty, as well as the competitiveness and growth of the Union market, to contribute to strengthening global cooperation on standardisation and taking into account existing international standards in the field of AI that are consistent with Union values, fundamental rights and interests, and to enhance multi-stakeholder governance ensuring a balanced representation of interests and the effective participation of all relevant stakeholders in accordance with Articles 5, 6, and 7 of Regulation (EU) No 1025/2012.
Article 41 – Common specifications
- The Commission may adopt, implementing acts establishing common specifications for the requirements set out in Section 2 of this Chapter or, as applicable, for the obligations set out in Sections 2 and 3 of Chapter V where the following conditions have been fulfilled:
(a) the Commission has requested, pursuant to Article 10(1) of Regulation (EU) No 1025/2012, one or more European standardisation organisations to draft a harmonised standard for the requirements set out in Section 2 of this Chapter, or, as applicable, for the obligations set out in Sections 2 and 3 of Chapter V, and:
(i) the request has not been accepted by any of the European standardisation organisations; or
(ii) the harmonised standards addressing that request are not delivered within the deadline set in accordance with Article 10(1) of Regulation (EU) No 1025/2012; or
(iii) the relevant harmonised standards insufficiently address fundamental rights concerns; or
(iv) the harmonised standards do not comply with the request; and
(b) no reference to harmonised standards covering the requirements referred to in Section 2 of this Chapter or, as applicable, the obligations referred to in Sections 2 and 3 of Chapter V has been published in the Official Journal of the European Union in accordance with Regulation (EU) No 1025/2012, and no such reference is expected to be published within a reasonable period.
Where drafting the common specifications, the Commission shall consult the advisory forum referred to in Article 67
The implementing acts referred to in the first subparagraph of this paragraph shall be adopted in accordance with the examination procedure referred to in Article 98(2).
- Before preparing a draft implementing act, the Commission shall inform the committee referred to in Article 22 of Regulation (EU) No 1025/2012 that it considers the conditions laid down in paragraph 1 of this Article to be fulfilled.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems or general-purpose AI models which are in conformity with the common specifications referred to in paragraph 1, or parts of those specifications, shall be presumed to be in conformity with the requirements set out in Section 2 of this Chapter, or, as applicable, to comply with the obligations referred to in Sections 2 and 3 of Chapter V, to the extent those common specifications cover those requirements of those obligations.
- Where a harmonised standard is adopted by a European standardisation organisation and proposed to the Commission for the publication of its reference in the Official Journal of the European Union, the Commission shall assess the harmonised standard in accordance with Regulation (EU) No 1025/2012. When reference to a harmonised standard is published in the Official Journal of the European Union, the Commission shall repeal the implementing acts referred to in paragraph 1, or parts thereof which cover the same requirements set out in Section 2 of this Chapter or, as applicable, the same obligations set out in Sections 2 and 3 of Chapter V.
- Where Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems or general-purpose AI models do not comply with the common specifications referred to in paragraph 1, they shall duly justify that they have adopted technical solutions that meet the requirements referred to in Section 2 of this Chapter, or, as applicable, comply with the obligations set out in Sections 2 and 3 of Chapter V to a level at least equivalent thereto.
- Where a Member State considers that a common specification does not entirely meet the requirements set out in Section 2, or, as applicable, comply with obligations set out in Sections 2 and 3 of Chapter V, it shall inform the Commission thereof with a detailed explanation. The Commission shall assess that information and, if appropriate, amend the implementing act establishing the common specification concerned.
Article 42 – Presumption of conformity with certain requirements
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems that have been trained and tested on Error! Post not found for word:data reflecting the specific geographical, behavioural, contextual or functional setting within which they are intended to be used shall be presumed to comply with the relevant requirements laid down in Article 10(4).
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems that have been certified or for which a statement of conformity has been issued under a Error! Post not found for word:cybersecurity scheme pursuant to Regulation (EU) 2019/881 and the references of which have been published in the Official Journal of the European Union shall be presumed to comply with the Error! Post not found for word:cybersecurity requirements set out in Article 15 of this Regulation in so far as the Error! Post not found for word:cybersecurity certificate or statement of conformity or parts thereof cover those requirements.
Article 43 – Conformity assessment
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in point 1 of Annex III, where, in demonstrating the compliance of a high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Section 2, the Error! Post not found for word:provider has applied harmonised standards referred to in Article 40, or, where applicable, common specifications referred to in Article 41, the Error! Post not found for word:provider shall opt for one of the following conformity assessment procedures based on:
(a) the internal control referred to in Annex VI; or
(b) the assessment of the quality management system and the assessment of the technical documentation, with the involvement of a Error! Post not found for word:notified body, referred to in Annex VII.
In demonstrating the compliance of a high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Section 2, the Error! Post not found for word:provider shall follow the conformity assessment procedure set out in Annex VII where:
(a) harmonised standards referred to in Article 40 do not exist, and common specifications referred to in Article 41 are not available;
(b) the Error! Post not found for word:provider has not applied, or has applied only part of, the harmonised standard;
(c) the common specifications referred to in point (a) exist, but the Error! Post not found for word:provider has not applied them;
(d) one or more of the harmonised standards referred to in point (a) has been published with a restriction, and only on the part of the Error! Post not found for word:standard that was restricted.
For the purposes of the conformity assessment procedure referred to in Annex VII, the Error! Post not found for word:provider may choose any of the notified bodies. However, where the high-Error! Post not found for word:risk Error! Post not found for word:ai system is intended to be put into service by Error! Post not found for word:law enforcement, immigration or asylum authorities or by Union institutions, bodies, offices or agencies, the market surveillance authority referred to in Article 74(8) or (9), as applicable, shall act as a Error! Post not found for word:notified body.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in points 2 to 8 of Annex III, Error! Post not found for word:providers shall follow the conformity assessment procedure based on internal control as referred to in Annex VI, which does not provide for the involvement of a Error! Post not found for word:notified body.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems covered by the Union harmonisation legislation listed in Section A of Annex I, the Error! Post not found for word:provider shall follow the relevant conformity assessment procedure as required under those legal acts. The requirements set out in Section 2 of this Chapter shall apply to those high-Error! Post not found for word:risk Error! Post not found for word:ai systems and shall be part of that assessment. Points 4.3., 4.4., 4.5. and the fifth paragraph of point 4.6 of Annex VII shall also apply.
For the purposes of that assessment, notified bodies which have been notified under those legal acts shall be entitled to control the conformity of the high-Error! Post not found for word:risk Error! Post not found for word:ai systems with the requirements set out in Section 2, provided that the compliance of those notified bodies with requirements laid down in Article 31(4), (5), (10) and (11) has been assessed in the context of the notification procedure under those legal acts.
Where a legal act listed in Section A of Annex I enables the product Error! Post not found for word:manufacturer to opt out from a third-party conformity assessment, provided that that Error! Post not found for word:manufacturer has applied all harmonised standards covering all the relevant requirements, that Error! Post not found for word:manufacturer may use that option only if it has also applied harmonised standards or, where applicable, common specifications referred to in Article 41, covering all requirements set out in Section 2 of this Chapter.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems that have already been Error! Post not found for word:subject to a conformity assessment procedure shall undergo a new conformity assessment procedure in the event of a substantial modification, regardless of whether the modified system is intended to be further distributed or continues to be used by the current Error! Post not found for word:deployer.
For high-Error! Post not found for word:risk Error! Post not found for word:ai systems that continue to learn after being placed on the market or put into service, changes to the high-Error! Post not found for word:risk Error! Post not found for word:ai system and its performance that have been pre-determined by the Error! Post not found for word:provider at the moment of the initial conformity assessment and are part of the information contained in the technical documentation referred to in point 2(f) of Annex IV, shall not constitute a substantial modification.
- The Commission is empower to adopt delegated acts in accordance with Article 97 in order to amend Annexes VI and VII by updating them in light of technical progress.
- The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend paragraphs 1 and 2 of this Article in order to Error! Post not found for word:subject high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in points 2 to 8 of Annex III to the conformity assessment procedure referred to in Annex VII or parts thereof. The Commission shall adopt such delegated acts taking into account the effectiveness of the conformity assessment procedure based on internal control referred to in Annex VI in preventing or minimising the risks to health and safety and protection of fundamental rights posed by such systems, as well as the Error! Post not found for word:availability of adequate capacities and resources among notified bodies.
Article 44 – Certificates
- Certificates issued by notified bodies in accordance with Annex VII shall be drawn-up in a language which can be easily understood by the relevant authorities in the Member State in which the Error! Post not found for word:notified body is established.
- Certificates shall be valid for the period they indicate, which shall not exceed five years for Error! Post not found for word:ai systems covered by Annex I, and four years for Error! Post not found for word:ai systems covered by Annex III. At the request of the Error! Post not found for word:provider, the validity of a certificate may be extended for further periods, each not exceeding five years for Error! Post not found for word:ai systems covered by Annex I, and four years for Error! Post not found for word:ai systems covered by Annex III, based on a re-assessment in accordance with the applicable conformity assessment procedures. Any supplement to a certificate shall remain valid, provided that the certificate which it supplements is valid.
- Where a Error! Post not found for word:notified body finds that an Error! Post not found for word:ai system no longer meets the requirements set out in Section 2, it shall, taking account of the principle of proportionality, suspend or withdraw the certificate issued or impose restrictions on it, unless compliance with those requirements is ensured by appropriate corrective action taken by the Error! Post not found for word:provider of the system within an appropriate deadline set by the Error! Post not found for word:notified body. The Error! Post not found for word:notified body shall give reasons for its decision.
An appeal procedure against decisions of the notified bodies, including on conformity certificates issued, shall be available.
Article 45 – Information obligations of notified bodies
- Notified bodies shall inform the notifying authority of the following:
(a) any Union technical documentation assessment certificates, any supplements to those certificates, and any quality management system approvals issued in accordance with the requirements of Annex VII;
(b) any refusal, restriction, suspension or withdrawal of a Union technical documentation assessment certificate or a quality management system approval issued in accordance with the requirements of Annex VII;
(c) any circumstances affecting the scope of or conditions for notification;
(d) any request for information which they have received from market surveillance authorities regarding conformity assessment activities;
(e) on request, conformity assessment activities performed within the scope of their notification and any other activity performed, including cross-border activities and subcontracting.
- Each Error! Post not found for word:notified body shall inform the other notified bodies of:
(a) quality management system approvals which it has refused, suspended or withdrawn, and, upon request, of quality system approvals which it has issued;
(b) Union technical documentation assessment certificates or any supplements thereto which it has refused, withdrawn, suspended or otherwise restricted, and, upon request, of the certificates and/or supplements thereto which it has issued.
- Each Error! Post not found for word:notified body shall provide the other notified bodies carrying out similar conformity assessment activities covering the same types of Error! Post not found for word:ai systems with relevant information on issues relating to negative and, on request, positive conformity assessment results.
- Notified bodies shall safeguard the confidentiality of the information that they obtain, in accordance with Article 78.
Article 46 – Derogation from conformity assessment procedure
- By way of derogation from Article 43 and upon a duly justified request, any market surveillance authority may authorise the placing on the market or the putting into service of specific high-Error! Post not found for word:risk Error! Post not found for word:ai systems within the territory of the Member State concerned, for exceptional reasons of public security or the protection of life and health of persons, environmental protection or the protection of key industrial and infrastructural assets. That authorisation shall be for a limited period while the necessary conformity assessment procedures are being carried out, taking into account the exceptional reasons justifying the derogation. The completion of those procedures shall be undertaken without undue delay.
- In a duly justified situation of urgency for exceptional reasons of public security or in the case of specific, substantial and imminent threat to the life or physical safety of natural persons, law-enforcement authorities or civil protection authorities may put a specific high-Error! Post not found for word:risk Error! Post not found for word:ai system into service without the authorisation referred to in paragraph 1, provided that such authorisation is requested during or after the use without undue delay. If the authorisation referred to in paragraph 1 is refused, the use of the high-Error! Post not found for word:risk Error! Post not found for word:ai system shall be stopped with immediate effect and all the results and outputs of such use shall be immediately discarded.
- The authorisation referred to in paragraph 1 shall be issued only if the market surveillance authority concludes that the high-Error! Post not found for word:risk Error! Post not found for word:ai system complies with the requirements of Section 2. The market surveillance authority shall inform the Commission and the other Member States of any authorisation issued pursuant to paragraphs 1 and 2. This obligation shall not cover sensitive operational data in relation to the activities of law-enforcement authorities.
- Where, within 15 calendar days of receipt of the information referred to in paragraph 3, no objection has been raised by either a Member State or the Commission in respect of an authorisation issued by a market surveillance authority of a Member State in accordance with paragraph 1, that authorisation shall be deemed justified.
- Where, within 15 calendar days of receipt of the notification referred to in paragraph 3, objections are raised by a Member State against an authorisation issued by a market surveillance authority of another Member State, or where the Commission considers the authorisation to be contrary to Union law, or the conclusion of the Member States regarding the compliance of the system as referred to in paragraph 3 to be unfounded, the Commission shall, without delay, enter into consultations with the relevant Member State. The Error! Post not found for word:operators concerned shall be consulted and have the possibility to present their views. Having regard thereto, the Commission shall decide whether the authorisation is justified. The Commission shall address its decision to the Member State concerned and to the relevant Error! Post not found for word:operators.
- Where the Commission considers the authorisation unjustified, it shall be withdrawn by the market surveillance authority of the Member State concerned.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems related to products covered by Union harmonisation legislation listed in Section A of Annex I, only the derogations from the conformity assessment established in that Union harmonisation legislation shall apply.
Article 47 – EU declaration of conformity
- The Error! Post not found for word:provider shall draw up a written machine readable, physical or electronically signed EU declaration of conformity for each high-Error! Post not found for word:risk Error! Post not found for word:ai system, and keep it at the disposal of the national competent authorities for 10 years after the high-Error! Post not found for word:risk Error! Post not found for word:ai system has been placed on the market or put into service. The EU declaration of conformity shall identify the high-Error! Post not found for word:risk Error! Post not found for word:ai system for which it has been drawn up. A copy of the EU declaration of conformity shall be submitted to the relevant national competent authorities upon request.
- The EU declaration of conformity shall state that the high-Error! Post not found for word:risk Error! Post not found for word:ai system concerned meets the requirements set out in Section 2. The EU declaration of conformity shall contain the information set out in Annex V, and shall be translated into a language that can be easily understood by the national competent authorities of the Member States in which the high-Error! Post not found for word:risk Error! Post not found for word:ai system is placed on the market or made available.
- Where high-Error! Post not found for word:risk Error! Post not found for word:ai systems are Error! Post not found for word:subject to other Union harmonisation legislation which also requires an EU declaration of conformity, a single EU declaration of conformity shall be drawn up in respect of all Union law applicable to the high-Error! Post not found for word:risk Error! Post not found for word:ai system. The declaration shall contain all the information required to identify the Union harmonisation legislation to which the declaration relates.
- By drawing up the EU declaration of conformity, the Error! Post not found for word:provider shall assume responsibility for compliance with the requirements set out in Section 2. The Error! Post not found for word:provider shall keep the EU declaration of conformity up-to-date as appropriate.
- The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend Annex V by updating the content of the EU declaration of conformity set out in that Annex, in order to introduce elements that become necessary in light of technical progress.
Article 48 – CE marking
- The Error! Post not found for word:ce marking shall be Error! Post not found for word:subject to the general principles set out in Article 30 of Regulation (EC) No 765/2008.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems provided digitally, a digital Error! Post not found for word:ce marking shall be used, only if it can easily be accessed via the interface from which that system is accessed or via an easily accessible machine-readable code or other electronic means.
- The Error! Post not found for word:ce marking shall be affixed visibly, legibly and indelibly for high-Error! Post not found for word:risk Error! Post not found for word:ai systems. Where that is not possible or not warranted on account of the nature of the high-Error! Post not found for word:risk Error! Post not found for word:ai system, it shall be affixed to the packaging or to the accompanying documentation, as appropriate.
- Where applicable, the Error! Post not found for word:ce marking shall be followed by the identification number of the Error! Post not found for word:notified body responsible for the conformity assessment procedures set out in Article 43. The identification number of the Error! Post not found for word:notified body shall be affixed by the body itself or, under its instructions, by the Error! Post not found for word:provider or by the Error! Post not found for word:provider’s authorised representative. The identification number shall also be indicated in any promotional material which mentions that the high-Error! Post not found for word:risk Error! Post not found for word:ai system fulfils the requirements for Error! Post not found for word:ce marking.
- Where high-Error! Post not found for word:risk Error! Post not found for word:ai systems are Error! Post not found for word:subject to other Union law which also provides for the affixing of the Error! Post not found for word:ce marking, the Error! Post not found for word:ce marking shall indicate that the high-Error! Post not found for word:risk Error! Post not found for word:ai system also fulfil the requirements of that other law.
Article 49 – Registration
- Before placing on the market or putting into service a high-Error! Post not found for word:risk Error! Post not found for word:ai system listed in Annex III, with the exception of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 2 of Annex III, the Error! Post not found for word:provider or, where applicable, the authorised representative shall register themselves and their system in the EU database referred to in Article 71.
- Before placing on the market or putting into service an Error! Post not found for word:ai system for which the Error! Post not found for word:provider has concluded that it is not high-Error! Post not found for word:risk according to Article 6(3), that Error! Post not found for word:provider or, where applicable, the authorised representative shall register themselves and that system in the EU database referred to in Article 71.
- Before putting into service or using a high-Error! Post not found for word:risk Error! Post not found for word:ai system listed in Annex III, with the exception of high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in point 2 of Annex III, Error! Post not found for word:deployers that are public authorities, Union institutions, bodies, offices or agencies or persons acting on their behalf shall register themselves, select the system and register its use in the EU database referred to in Article 71.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in points 1, 6 and 7 of Annex III, in the areas of Error! Post not found for word:law enforcement, migration, asylum and border control management, the registration referred to in paragraphs 1, 2 and 3 of this Article shall be in a secure non-public section of the EU database referred to in Article 71 and shall include only the following information, as applicable, referred to in:
(a) Section A, points 1 to 10, of Annex VIII, with the exception of points 6, 8 and 9;
(b) Section B, points 1 to 5, and points 8 and 9 of Annex VIII;
(c) Section C, points 1 to 3 of Annex VIII;
(d) points 1, 2, 3, and 5, of Annex IX.
Only the Commission and national authorities referred to in Article 74(8) shall have access to the respective restricted sections of the EU database listed in the first subparagraph of this paragraph.
- High-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 2 of Annex III shall be registered at national level.
CHAPTER IV – TRANSPARENCY OBLIGATIONS FOR PROVIDERS AND DEPLOYERS OF CERTAIN AI SYSTEMS
Article 50 – Transparency obligations for providers and deployers of certain AI systems
- Error! Post not found for word:providers shall ensure that Error! Post not found for word:ai systems intended to interact directly with natural persons are designed and developed in such a way that the natural persons concerned are informed that they are interacting with an Error! Post not found for word:ai system, unless this is obvious from the point of view of a natural person who is reasonably well-informed, observant and circumspect, taking into account the circumstances and the context of use. This obligation shall not apply to Error! Post not found for word:ai systems authorised by law to detect, prevent, investigate or prosecute criminal offences, Error! Post not found for word:subject to appropriate safeguards for the rights and freedoms of third parties, unless those systems are available for the public to report a criminal offence.
- Error! Post not found for word:providers of Error! Post not found for word:ai systems, including general-purpose AI systems, generating synthetic audio, image, video or text content, shall ensure that the outputs of the Error! Post not found for word:ai system are marked in a machine-readable format and detectable as artificially generated or manipulated. Error! Post not found for word:providers shall ensure their technical solutions are effective, interoperable, robust and reliable as far as this is technically feasible, taking into account the specificities and limitations of various types of content, the costs of implementation and the generally acknowledged state-of-the-art, as may be reflected in relevant technical standards. This obligation shall not apply to the extent the Error! Post not found for word:ai systems perform an assistive function for Error! Post not found for word:standard editing or do not substantially alter the Error! Post not found for word:input data provided by the Error! Post not found for word:deployer or the semantics thereof, or where authorised by law to detect, prevent, investigate or prosecute criminal offences.
- Error! Post not found for word:deployers of an emotion recognition system or a biometric categorisation system shall inform the natural persons exposed thereto of the operation of the system, and shall process the Error! Post not found for word:personal Error! Post not found for word:data in accordance with Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680, as applicable. This obligation shall not apply to Error! Post not found for word:ai systems used for biometric categorisation and emotion recognition, which are permitted by law to detect, prevent or investigate criminal offences, Error! Post not found for word:subject to appropriate safeguards for the rights and freedoms of third parties, and in accordance with Union law.
- Error! Post not found for word:deployers of an Error! Post not found for word:ai system that generates or manipulates image, audio or video content constituting a Error! Post not found for word:deep fake, shall disclose that the content has been artificially generated or manipulated. This obligation shall not apply where the use is authorised by law to detect, prevent, investigate or prosecute criminal offence. Where the content forms part of an evidently artistic, creative, satirical, fictional analogous work or programme, the transparency obligations set out in this paragraph are limited to disclosure of the existence of such generated or manipulated content in an appropriate manner that does not hamper the display or enjoyment of the work.
Error! Post not found for word:deployers of an Error! Post not found for word:ai system that generates or manipulates text which is published with the purpose of informing the public on matters of public interest shall disclose that the text has been artificially generated or manipulated. This obligation shall not apply where the use is authorised by law to detect, prevent, investigate or prosecute criminal offences or where the AI-generated content has undergone a process of human review or editorial control and where a natural or legal person holds editorial responsibility for the publication of the content.
- The information referred to in paragraphs 1 to 4 shall be provided to the natural persons concerned in a clear and distinguishable manner at the latest at the time of the first interaction or exposure. The information shall conform to the applicable accessibility requirements.
- Paragraphs 1 to 4 shall not affect the requirements and obligations set out in Chapter III, and shall be without prejudice to other transparency obligations laid down in Union or national law for Error! Post not found for word:deployers of Error! Post not found for word:ai systems.
- The Error! Post not found for word:ai office shall encourage and facilitate the drawing up of codes of practice at Union level to facilitate the effective implementation of the obligations regarding the detection and labelling of artificially generated or manipulated content. The Commission may adopt implementing acts to approve those codes of practice in accordance with the procedure laid down in Article 56 (6). If it deems the code is not adequate, the Commission may adopt an implementing act specifying common rules for the implementation of those obligations in accordance with the examination procedure laid down in Article 98(2).
CHAPTER V – GENERAL-PURPOSE AI MODELS
Section 1 – Classification rules
Article 51 – Classification of general-purpose AI models as general-purpose AI models with systemic risk
- A general-purpose AI model shall be classified as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk if it meets any of the following conditions:
(a) it has high impact capabilities evaluated on the basis of appropriate technical tools and methodologies, including indicators and benchmarks;
(b) based on a decision of the Commission, ex officio or following a qualified alert from the scientific panel, it has capabilities or an impact equivalent to those set out in point (a) having regard to the criteria set out in Annex XIII.
- A general-purpose AI model shall be presumed to have high impact capabilities pursuant to paragraph 1, point (a), when the cumulative amount of computation used for its training measured in floating point operations is greater than 10^25.
- The Commission shall adopt delegated acts in accordance with Article 97 to amend the thresholds listed in paragraphs 1 and 2 of this Article, as well as to supplement benchmarks and indicators in light of evolving technological developments, such as algorithmic improvements or increased Error! Post not found for word:hardware efficiency, when necessary, for these thresholds to reflect the state of the art.
Article 52 – Procedure
- Where a general-purpose AI model meets the conditions referred to in Article 51(1), point (a), the relevant Error! Post not found for word:provider shall notify the Commission without delay and in any event within two weeks after that requirement is met or it becomes known that it will be met. That notification shall include the information necessary to demonstrate that the relevant requirement has been met. If the Commission becomes aware of a general-purpose AI model presenting Error! Post not found for word:systemic risks of which it has not been notified, it may decide to designate it as a model with Error! Post not found for word:systemic Error! Post not found for word:risk.
- The Error! Post not found for word:provider of a general-purpose AI model that meets the condition referred to in Article 51(1), point (a), may present, with its notification, sufficiently substantiated arguments to demonstrate that, exceptionally, although it meets that requirement, the general-purpose AI model does not present, due to its specific characteristics, Error! Post not found for word:systemic risks and therefore should not be classified as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk.
- Where the Commission concludes that the arguments submitted pursuant to paragraph 2 are not sufficiently substantiated and the relevant Error! Post not found for word:provider was not able to demonstrate that the general-purpose AI model does not present, due to its specific characteristics, Error! Post not found for word:systemic risks, it shall reject those arguments, and the general-purpose AI model shall be considered to be a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk.
- The Commission may designate a general-purpose AI model as presenting Error! Post not found for word:systemic risks, ex officio or following a qualified alert from the scientific panel pursuant to Article 90(1), point (a), on the basis of criteria set out in Annex XIII.
The Commission is empowered to adopt delegated acts in accordance with Article 97 in order to amend Annex XIII by specifying and updating the criteria set out in that Annex.
- Upon a reasoned request of a Error! Post not found for word:provider whose model has been designated as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk pursuant to paragraph 4, the Commission shall take the request into account and may decide to reassess whether the general-purpose AI model can still be considered to present Error! Post not found for word:systemic risks on the basis of the criteria set out in Annex XIII. Such a request shall contain objective, detailed and new reasons that have arisen since the designation decision. Error! Post not found for word:providers may request reassessment at the earliest six months after the designation decision. Where the Commission, following its reassessment, decides to maintain the designation as a general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk, Error! Post not found for word:providers may request reassessment at the earliest six months after that decision.
- The Commission shall ensure that a list of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk is published and shall keep that list up to date, without prejudice to the need to observe and protect intellectual property rights and confidential business information or trade secrets in accordance with Union and national law.
Section 2 – Obligations for providers of general-purpose AI models
Article 53 – Obligations for providers of general-purpose AI models
- Error! Post not found for word:providers of general-purpose AI models shall:
(a) draw up and keep up-to-date the technical documentation of the model, including its training and testing process and the results of its evaluation, which shall contain, at a minimum, the information set out in Annex XI for the purpose of providing it, upon request, to the Error! Post not found for word:ai office and the national competent authorities;
(b) draw up, keep up-to-date and make available information and documentation to Error! Post not found for word:providers of Error! Post not found for word:ai systems who intend to integrate the general-purpose AI model into their Error! Post not found for word:ai systems. Without prejudice to the need to observe and protect intellectual property rights and confidential business information or trade secrets in accordance with Union and national law, the information and documentation shall:
(i) enable Error! Post not found for word:providers of Error! Post not found for word:ai systems to have a good understanding of the capabilities and limitations of the general-purpose AI model and to comply with their obligations pursuant to this Regulation; and
(ii) contain, at a minimum, the elements set out in Annex XII;
(c) put in place a policy to comply with Union law on copyright and related rights, and in particular to identify and comply with, including through state-of-the-art technologies, a reservation of rights expressed pursuant to Article 4(3) of Directive (EU) 2019/790;
(d) draw up and make publicly available a sufficiently detailed summary about the content used for training of the general-purpose AI model, according to a template provided by the Error! Post not found for word:ai office.
- The obligations set out in paragraph 1, points (a) and (b), shall not apply to Error! Post not found for word:providers of AI models that are released under a free and open-source licence that allows for the access, usage, modification, and distribution of the model, and whose parameters, including the weights, the information on the model architecture, and the information on model usage, are made publicly available. This exception shall not apply to general-purpose AI models with Error! Post not found for word:systemic risks.
- Error! Post not found for word:providers of general-purpose AI models shall cooperate as necessary with the Commission and the national competent authorities in the exercise of their competences and powers pursuant to this Regulation.
- Error! Post not found for word:providers of general-purpose AI models may rely on codes of practice within the meaning of Article 56 to demonstrate compliance with the obligations set out in paragraph 1 of this Article, until a harmonised standard is published. Compliance with European harmonised standards grants Error! Post not found for word:providers the presumption of conformity to the extent that those standards cover those obligations. Error! Post not found for word:providers of general-purpose AI models who do not adhere to an approved code of practice or do not comply with a European harmonized Error! Post not found for word:standard shall demonstrate alternative adequate means of compliance for assessment by the Commission.
- For the purpose of facilitating compliance with Annex XI, in particular points 2 (d) and (e) thereof, the Commission is empowered to adopt delegated acts in accordance with Article 97 to detail measurement and calculation methodologies with a view to allowing for comparable and verifiable documentation.
- The Commission is empowered to adopt delegated acts in accordance with Article 97(2) to amend Annexes XI and XII in the light of evolving technological developments.
- Any information or documentation obtained pursuant to this Article, including trade secrets, shall be treated in accordance with the confidentiality obligations set out in Article 78.
Article 54 – Authorised representatives of providers of general-purpose AI models
- Prior to placing a general-purpose AI model on the Union market, Error! Post not found for word:providers established in third countries shall, by written mandate, appoint an authorised representative which is established in the Union.
- The Error! Post not found for word:provider shall enable its authorised representative to perform the tasks specified in the mandate received from the Error! Post not found for word:provider.
- The authorised representative shall perform the tasks specified in the mandate received from the Error! Post not found for word:provider. It shall provide a copy of the mandate to the Error! Post not found for word:ai office upon request, in one of the official languages of the institutions of the Union. For the purposes of this Regulation, the mandate shall empower the authorised representative to carry out the following tasks:
(a) verify that the technical documentation specified in Annex XI has been drawn up and all obligations referred to in Article 53 and, where applicable, Article 55 have been fulfilled by the Error! Post not found for word:provider;
(b) keep a copy of the technical documentation specified in Annex XI at the disposal of the Error! Post not found for word:ai office and national competent authorities, for a period of 10 years after the general-purpose AI model has been placed on the market, and the contact details of the Error! Post not found for word:provider that appointed the authorised representative;
(c) provide the Error! Post not found for word:ai office, upon a reasoned request, with all the information and documentation, including that referred to in point (b), necessary to demonstrate compliance with the obligations in this Chapter;
(d) cooperate with the Error! Post not found for word:ai office and competent authorities, upon a reasoned request, in any action they take in relation to the general-purpose AI model, including when the model is integrated into Error! Post not found for word:ai systems placed on the market or put into service in the Union.
- The mandate shall empower the authorised representative to be addressed, in addition to or instead of the Error! Post not found for word:provider, by the Error! Post not found for word:ai office or the competent authorities, on all issues related to ensuring compliance with this Regulation.
- The authorised representative shall terminate the mandate if it considers or has reason to consider the Error! Post not found for word:provider to be acting contrary to its obligations pursuant to this Regulation. In such a case, it shall also immediately inform the Error! Post not found for word:ai office about the termination of the mandate and the reasons therefor.
- The obligation set out in this Article shall not apply to Error! Post not found for word:providers of general-purpose AI models that are released under a free and open-source licence that allows for the access, usage, modification, and distribution of the model, and whose parameters, including the weights, the information on the model architecture, and the information on model usage, are made publicly available, unless the general-purpose AI models present Error! Post not found for word:systemic risks.
Section 3 – Obligations of providers of general-purpose AI models with systemic risk
Article 55 – Obligations of providers of general-purpose AI models with systemic risk
- In addition to the obligations listed in Articles 53 and 54, Error! Post not found for word:providers of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk shall:
(a) perform model evaluation in accordance with standardised protocols and tools reflecting the state of the art, including conducting and documenting adversarial testing of the model with a view to identifying and mitigating Error! Post not found for word:systemic risks;
(b) assess and mitigate possible Error! Post not found for word:systemic risks at Union level, including their sources, that may stem from the development, the placing on the market, or the use of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk;
(c) keep track of, document and report without undue delay to the Error! Post not found for word:ai office and, as appropriate, to national competent authorities, relevant information about Error! Post not found for word:serious Error! Post not found for word:incidents and possible corrective measures to address them;
(d) ensure an adequate level of Error! Post not found for word:cybersecurity protection for the general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk and the physical infrastructure of the model.
- Error! Post not found for word:providers of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk may rely on codes of practice within the meaning of Article 56 to demonstrate compliance with the obligations set out in paragraph 1 of this Article, until a harmonised standard is published. Compliance with European harmonised standards grants Error! Post not found for word:providers the presumption of conformity to the extent that those standards cover those obligations. Error! Post not found for word:providers of general-purpose AI models with Error! Post not found for word:systemic risks who do not adhere to an approved code of practice or do not comply with European harmonised standards shall demonstrate alternative adequate means of compliance for assessment by the Commission.
- Any information or documentation obtained pursuant to this Article, including trade secrets, shall be treated in accordance with the confidentiality obligations set out in Article 78.
Article 56 – Codes of practice
- The Error! Post not found for word:ai office shall encourage and facilitate the drawing up of codes of practice at Union level in order to contribute to the proper application of this Regulation, taking into account international approaches.
- The Error! Post not found for word:ai office and the Board shall aim to ensure that the codes of practice cover at least the obligations provided for in Articles 53 and 55, including the following issues:
(a) the means to ensure that the information referred to in Article 53(1), points (a) and (b), is kept up to date in light of market and technological developments;
(b) the adequate level of detail for the summary about the content used for training;
(c) the identification of the type and nature of the Error! Post not found for word:systemic risks at Union level, including their sources, where appropriate;
(d) the measures, procedures and modalities for the assessment and management of the Error! Post not found for word:systemic risks at Union level, including the documentation thereof, which shall be proportionate to the risks, take into consideration their severity and probability and take into account the specific challenges of tackling those risks in light of the possible ways in which such risks may emerge and materialise along the AI value chain.
- The Error! Post not found for word:ai office may invite all Error! Post not found for word:providers of general-purpose AI models, as well as relevant national competent authorities, to participate in the drawing-up of codes of practice. Civil society organisations, industry, academia and other relevant stakeholders, such as downstream providers and independent experts, may support the process.
- The Error! Post not found for word:ai office and the Board shall aim to ensure that the codes of practice clearly set out their specific objectives and contain commitments or measures, including key performance indicators as appropriate, to ensure the achievement of those objectives, and that they take due account of the needs and interests of all interested parties, including affected persons, at Union level.
- The Error! Post not found for word:ai office shall aim to ensure that participants to the codes of practice report regularly to the Error! Post not found for word:ai office on the implementation of the commitments and the measures taken and their outcomes, including as measured against the key performance indicators as appropriate. Key performance indicators and reporting commitments shall reflect differences in size and capacity between various participants.
- The Error! Post not found for word:ai office and the Board shall regularly monitor and evaluate the achievement of the objectives of the codes of practice by the participants and their contribution to the proper application of this Regulation. The Error! Post not found for word:ai office and the Board shall assess whether the codes of practice cover the obligations provided for in Articles 53 and 55, and shall regularly monitor and evaluate the achievement of their objectives. They shall publish their assessment of the adequacy of the codes of practice.
The Commission may, by way of an implementing act, approve a code of practice and give it a general validity within the Union. That implementing act shall be adopted in accordance with the examination procedure referred to in Article 98(2).
- The Error! Post not found for word:ai office may invite all Error! Post not found for word:providers of general-purpose AI models to adhere to the codes of practice. For Error! Post not found for word:providers of general-purpose AI models not presenting Error! Post not found for word:systemic risks this adherence may be limited to the obligations provided for in Article 53, unless they declare explicitly their interest to join the full code.
- The Error! Post not found for word:ai office shall, as appropriate, also encourage and facilitate the review and adaptation of the codes of practice, in particular in light of emerging standards. The Error! Post not found for word:ai office shall assist in the assessment of available standards.
- Codes of practice shall be ready at the latest by 2 May 2025. The Error! Post not found for word:ai office shall take the necessary steps, including inviting Error! Post not found for word:providers pursuant to paragraph 7.
If, by 2 August 2025, a code of practice cannot be finalised, or if the Error! Post not found for word:ai office deems it is not adequate following its assessment under paragraph 6 of this Article, the Commission may provide, by means of implementing acts, common rules for the implementation of the obligations provided for in Articles 53 and 55, including the issues set out in paragraph 2 of this Article. Those implementing acts shall be adopted in accordance with the examination procedure referred to in Article 98(2).
CHAPTER VI – MEASURES IN SUPPORT OF INNOVATION
Article 57 – AI regulatory sandboxes
- Member States shall ensure that their competent authorities establish at least one AI regulatory sandbox at national level, which shall be operational by 2 August 2026. That sandbox may also be established jointly with the competent authorities of other Member States. The Commission may provide technical support, advice and tools for the establishment and operation of AI regulatory sandboxes.
The obligation under the first subparagraph may also be fulfilled by participating in an existing sandbox in so far as that participation provides an equivalent level of national coverage for the participating Member States.
- Additional AI regulatory sandboxes at regional or local level, or established jointly with the competent authorities of other Member States may also be established.
- The European Error! Post not found for word:data Protection Supervisor may also establish an AI regulatory sandbox for Union institutions, bodies, offices and agencies, and may exercise the roles and the tasks of national competent authorities in accordance with this Chapter.
- Member States shall ensure that the competent authorities referred to in paragraphs 1 and 2 allocate sufficient resources to comply with this Article effectively and in a timely manner. Where appropriate, national competent authorities shall cooperate with other relevant authorities, and may allow for the involvement of other actors within the AI ecosystem. This Article shall not affect other regulatory sandboxes established under Union or national law. Member States shall ensure an appropriate level of cooperation between the authorities supervising those other sandboxes and the national competent authorities.
- AI regulatory sandboxes established under paragraph 1 shall provide for a controlled environment that fosters innovation and facilitates the development, training, testing and validation of innovative Error! Post not found for word:ai systems for a limited time before their being placed on the market or put into service pursuant to a specific Error! Post not found for word:sandbox plan agreed between Error! Post not found for word:providers or the prospective Error! Post not found for word:providers and the competent authority. Such regulatory sandboxes may include testing in real world conditions supervised therein.
- Competent authorities shall provide, as appropriate, guidance, supervision and support within the AI sandbox with a view to identifying risks, in particular to fundamental rights, health and safety, testing, mitigation measures, and their effectiveness in relation to the obligations and requirements of this Regulation and, where relevant, other Union and national law supervised within the sandbox.
- Competent authorities shall provide Error! Post not found for word:providers and prospective Error! Post not found for word:providers participating in the AI regulatory sandbox with guidance on regulatory expectations and how to fulfil the requirements and obligations set out in this Regulation.
Upon request of the Error! Post not found for word:provider or prospective Error! Post not found for word:provider of the Error! Post not found for word:ai system, the competent authority shall provide a written proof of the activities successfully carried out in the sandbox. The competent authority shall also provide an exit report detailing the activities carried out in the sandbox and the related results and learning outcomes. Error! Post not found for word:providers may use such documentation to demonstrate their compliance with this Regulation through the conformity assessment process or relevant market surveillance activities. In this regard, the exit reports and the written proof provided by the national competent authority shall be taken positively into account by market surveillance authorities and notified bodies, with a view to accelerating conformity assessment procedures to a reasonable extent.
- Error! Post not found for word:subject to the confidentiality provisions in Article 78, and with the agreement of the Error! Post not found for word:provider or prospective Error! Post not found for word:provider, the Commission and the Board shall be authorised to access the exit reports and shall take them into account, as appropriate, when exercising their tasks under this Regulation. If both the Error! Post not found for word:provider or prospective Error! Post not found for word:provider and the national competent authority explicitly agree, the exit report may be made publicly available through the single information platform referred to in this Article.
- The establishment of AI regulatory sandboxes shall aim to contribute to the following objectives:
(a) improving legal certainty to achieve regulatory compliance with this Regulation or, where relevant, other applicable Union and national law;
(b) supporting the sharing of best practices through cooperation with the authorities involved in the AI regulatory sandbox;
(c) fostering innovation and competitiveness and facilitating the development of an AI ecosystem;
(d) contributing to evidence-based regulatory learning;
(e) facilitating and accelerating access to the Union market for Error! Post not found for word:ai systems, in particular when provided by SMEs, including start-ups.
- National competent authorities shall ensure that, to the extent the innovative Error! Post not found for word:ai systems involve the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data or otherwise fall under the supervisory remit of other national authorities or competent authorities providing or supporting access to Error! Post not found for word:data, the national Error! Post not found for word:data protection authorities and those other national or competent authorities are associated with the operation of the AI regulatory sandbox and involved in the supervision of those aspects to the extent of their respective tasks and powers.
- The AI regulatory sandboxes shall not affect the supervisory or corrective powers of the competent authorities supervising the sandboxes, including at regional or local level. Any significant risks to health and safety and fundamental rights identified during the development and testing of such Error! Post not found for word:ai systems shall result in an adequate mitigation. National competent authorities shall have the power to temporarily or permanently suspend the testing process, or the participation in the sandbox if no effective mitigation is possible, and shall inform the Error! Post not found for word:ai office of such decision. National competent authorities shall exercise their supervisory powers within the limits of the relevant law, using their discretionary powers when implementing legal provisions in respect of a specific AI regulatory sandbox project, with the objective of supporting innovation in AI in the Union.
- Error! Post not found for word:providers and prospective Error! Post not found for word:providers participating in the AI regulatory sandbox shall remain liable under applicable Union and national liability law for any damage inflicted on third parties as a result of the experimentation taking place in the sandbox. However, provided that the prospective Error! Post not found for word:providers observe the specific plan and the terms and conditions for their participation and follow in good faith the guidance given by the national competent authority, no administrative fines shall be imposed by the authorities for infringements of this Regulation. Where other competent authorities responsible for other Union and national law were actively involved in the supervision of the Error! Post not found for word:ai system in the sandbox and provided guidance for compliance, no administrative fines shall be imposed regarding that law.
- The AI regulatory sandboxes shall be designed and implemented in such a way that, where relevant, they facilitate cross-border cooperation between national competent authorities.
- National competent authorities shall coordinate their activities and cooperate within the framework of the Board.
- National competent authorities shall inform the Error! Post not found for word:ai office and the Board of the establishment of a sandbox, and may ask them for support and guidance. The Error! Post not found for word:ai office shall make publicly available a list of planned and existing sandboxes and keep it up to date in order to encourage more interaction in the AI regulatory sandboxes and cross-border cooperation.
- National competent authorities shall submit annual reports to the Error! Post not found for word:ai office and to the Board, from one year after the establishment of the AI regulatory sandbox and every year thereafter until its termination and a final report. Those reports shall provide information on the progress and results of the implementation of those sandboxes, including best practices, Error! Post not found for word:incidents, lessons learnt and recommendations on their setup and, where relevant, on the application and possible revision of this Regulation, including its delegated and implementing acts, and on the application of other Union law supervised by the competent authorities within the sandbox. The national competent authorities shall make those annual reports or abstracts thereof available to the public, online. The Commission shall, where appropriate, take the annual reports into account when exercising its tasks under this Regulation.
- The Commission shall develop a single and dedicated interface containing all relevant information related to AI regulatory sandboxes to allow stakeholders to interact with AI regulatory sandboxes and to raise enquiries with competent authorities, and to seek non-binding guidance on the conformity of innovative products, services, business models embedding AI technologies, in accordance with Article 62(1), point (c). The Commission shall proactively coordinate with national competent authorities, where relevant.
Article 58 – Detailed arrangements for and functioning of AI regulatory sandboxes
- In order to avoid fragmentation across the Union, the Commission shall adopt implementing acts specifying the detailed arrangements for the establishment, development, implementation, operation and supervision of the AI regulatory sandboxes. The implementing acts shall include common principles on the following issues:
(a) eligibility and selection criteria for participation in the AI regulatory sandbox;
(b) procedures for the application, participation, monitoring, exiting from and termination of the AI regulatory sandbox, including the Error! Post not found for word:sandbox plan and the exit report;
(c) the terms and conditions applicable to the participants.
Those implementing acts shall be adopted in accordance with the examination procedure referred to in Article 98(2).
- The implementing acts referred to in paragraph 1 shall ensure:
(a) that AI regulatory sandboxes are open to any applying Error! Post not found for word:provider or prospective Error! Post not found for word:provider of an Error! Post not found for word:ai system who fulfils eligibility and selection criteria, which shall be transparent and fair, and that national competent authorities inform applicants of their decision within three months of the application;
(b) that AI regulatory sandboxes allow broad and equal access and keep up with demand for participation; Error! Post not found for word:providers and prospective Error! Post not found for word:providers may also submit applications in partnerships with Error! Post not found for word:deployers and other relevant third parties;
(c) that the detailed arrangements for and conditions concerning AI regulatory sandboxes support, to the best extent possible, flexibility for national competent authorities to establish and operate their AI regulatory sandboxes;
(d) that access to the AI regulatory sandboxes is free of charge for SMEs, including start-ups, without prejudice to exceptional costs that national competent authorities may recover in a fair and proportionate manner;
(e) that they facilitate Error! Post not found for word:providers and prospective Error! Post not found for word:providers, by means of the learning outcomes of the AI regulatory sandboxes, in complying with conformity assessment obligations under this Regulation and the voluntary application of the Error! Post not found for word:codes of conduct referred to in Article 95;
(f) that AI regulatory sandboxes facilitate the involvement of other relevant actors within the AI ecosystem, such as notified bodies and standardisation organisations, SMEs, including start-ups, enterprises, innovators, testing and experimentation facilities, research and experimentation labs and European Digital Innovation Hubs, centres of excellence, individual researchers, in order to allow and facilitate cooperation with the public and private sectors;
(g) that procedures, processes and administrative requirements for application, selection, participation and exiting the AI regulatory sandbox are simple, easily intelligible, and clearly communicated in order to facilitate the participation of SMEs, including start-ups, with limited legal and administrative capacities and are streamlined across the Union, in order to avoid fragmentation and that participation in an AI regulatory sandbox established by a Member State, or by the European Error! Post not found for word:data Protection Supervisor is mutually and uniformly recognised and carries the same legal effects across the Union;
(h) that participation in the AI regulatory sandbox is limited to a period that is appropriate to the complexity and scale of the project, and that may be extended by the national competent authority;
(i) that AI regulatory sandboxes facilitate the development of tools and infrastructure for testing, benchmarking, assessing and explaining dimensions of Error! Post not found for word:ai systems relevant for regulatory learning, such as Error! Post not found for word:accuracy, robustness and Error! Post not found for word:cybersecurity, as well as measures to mitigate risks to fundamental rights and society at large.
- Prospective Error! Post not found for word:providers in the AI regulatory sandboxes, in particular SMEs and start-ups, shall be directed, where relevant, to pre-deployment services such as guidance on the implementation of this Regulation, to other value-adding services such as help with standardisation documents and certification, testing and experimentation facilities, European Digital Innovation Hubs and centres of excellence.
- Where national competent authorities consider authorising testing in real world conditions supervised within the framework of an AI regulatory sandbox to be established under this Article, they shall specifically agree on the terms and conditions of such testing and, in particular, the appropriate safeguards with the participants, with a view to protecting fundamental rights, health and safety. Where appropriate, they shall cooperate with other national competent authorities with a view to ensuring consistent practices across the Union.
Article 59 – Further processing of personal data for developing certain AI systems in the public interest in the AI regulatory sandbox
- In the AI regulatory sandbox, Error! Post not found for word:personal Error! Post not found for word:data lawfully collected for other purposes may be processed solely for the purpose of developing, training and testing certain Error! Post not found for word:ai systems in the sandbox when all of the following conditions are met:
(a) Error! Post not found for word:ai systems shall be developed for safeguarding substantial public interest by a public authority or another natural or legal person and in one or more of the following areas:
(i) public safety and public health, including disease detection, diagnosis prevention, control and treatment and improvement of health care systems;
(ii) a high level of protection and improvement of the quality of the environment, protection of biodiversity, protection against pollution, green transition measures, climate change mitigation and adaptation measures;
(iii) energy sustainability;
(iv) safety and resilience of transport systems and mobility, critical infrastructure and networks;
(v) efficiency and quality of public administration and public services;
(b) the Error! Post not found for word:data processed are necessary for complying with one or more of the requirements referred to in Chapter III, Section 2 where those requirements cannot effectively be fulfilled by Error! Post not found for word:processing anonymised, synthetic or other Error! Post not found for word:non\-personal Error! Post not found for word:data;
(c) there are effective monitoring mechanisms to identify if any high risks to the rights and freedoms of the Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects, as referred to in Article 35 of Regulation (EU) 2016/679 and in Article 39 of Regulation (EU) 2018/1725, may arise during the sandbox experimentation, as well as response mechanisms to promptly mitigate those risks and, where necessary, stop the Error! Post not found for word:processing;
(d) any Error! Post not found for word:personal Error! Post not found for word:data to be processed in the context of the sandbox are in a functionally separate, isolated and protected Error! Post not found for word:data Error! Post not found for word:processing environment under the control of the prospective Error! Post not found for word:provider and only authorised persons have access to those Error! Post not found for word:data;
(e) Error! Post not found for word:providers can further share the originally collected Error! Post not found for word:data only in accordance with Union Error! Post not found for word:data protection law; any Error! Post not found for word:personal Error! Post not found for word:data created in the sandbox cannot be shared outside the sandbox;
(f) any Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data in the context of the sandbox neither leads to measures or decisions affecting the Error! Post not found for word:Error! Post not found for word:data Error! Post not found for word:subjects nor does it affect the application of their rights laid down in Union law on the protection of Error! Post not found for word:personal Error! Post not found for word:data;
(g) any Error! Post not found for word:personal Error! Post not found for word:data processed in the context of the sandbox are protected by means of appropriate technical and organisational measures and deleted once the participation in the sandbox has terminated or the Error! Post not found for word:personal Error! Post not found for word:data has reached the end of its retention period;
(h) the logs of the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data in the context of the sandbox are kept for the duration of the participation in the sandbox, unless provided otherwise by Union or national law;
(i) a complete and detailed description of the process and rationale behind the training, testing and validation of the Error! Post not found for word:ai system is kept together with the testing results as part of the technical documentation referred to in Annex IV;
(j) a short summary of the AI project developed in the sandbox, its objectives and expected results is published on the website of the competent authorities; this obligation shall not cover sensitive operational data in relation to the activities of Error! Post not found for word:law enforcement, border control, immigration or asylum authorities.
- For the purposes of the prevention, investigation, detection or prosecution of criminal offences or the execution of criminal penalties, including safeguarding against and preventing threats to public security, under the control and responsibility of Error! Post not found for word:law enforcement authorities, the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data in AI regulatory sandboxes shall be based on a specific Union or national law and Error! Post not found for word:subject to the same cumulative conditions as referred to in paragraph 1.
- Paragraph 1 is without prejudice to Union or national law which excludes Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data for other purposes than those explicitly mentioned in that law, as well as to Union or national law laying down the basis for the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data which is necessary for the purpose of developing, testing or training of innovative Error! Post not found for word:ai systems or any other legal basis, in compliance with Union law on the protection of Error! Post not found for word:personal Error! Post not found for word:data.
Article 60 – Testing of high-risk AI systems in real world conditions outside AI regulatory sandboxes
- Testing of high-Error! Post not found for word:risk Error! Post not found for word:ai systems in real world conditions outside AI regulatory sandboxes may be conducted by Error! Post not found for word:providers or prospective Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in Annex III, in accordance with this Article and the real-world testing plan referred to in this Article, without prejudice to the prohibitions under Article 5.
The Commission shall, by means of implementing acts, specify the detailed elements of the real-world testing plan. Those implementing acts shall be adopted in accordance with the examination procedure referred to in Article 98(2).
This paragraph shall be without prejudice to Union or national law on the testing in real world conditions of high-Error! Post not found for word:risk Error! Post not found for word:ai systems related to products covered by Union harmonisation legislation listed in Annex I.
- Error! Post not found for word:providers or prospective Error! Post not found for word:providers may conduct testing of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Annex III in real world conditions at any time before the placing on the market or the putting into service of the Error! Post not found for word:ai system on their own or in partnership with one or more Error! Post not found for word:deployers or prospective Error! Post not found for word:deployers.
- The testing of high-Error! Post not found for word:risk Error! Post not found for word:ai systems in real world conditions under this Article shall be without prejudice to any ethical review that is required by Union or national law.
- Error! Post not found for word:providers or prospective Error! Post not found for word:providers may conduct the testing in real world conditions only where all of the following conditions are met:
(a) the Error! Post not found for word:provider or prospective Error! Post not found for word:provider has drawn up a real-world testing plan and submitted it to the market surveillance authority in the Member State where the testing in real world conditions is to be conducted;
(b) the market surveillance authority in the Member State where the testing in real world conditions is to be conducted has approved the testing in real world conditions and the real-world testing plan; where the market surveillance authority has not provided an answer within 30 days, the testing in real world conditions and the real-world testing plan shall be understood to have been approved; where national law does not provide for a tacit approval, the testing in real world conditions shall remain Error! Post not found for word:subject to an authorisation;
(c) the Error! Post not found for word:provider or prospective Error! Post not found for word:provider, with the exception of Error! Post not found for word:providers or prospective Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in points 1, 6 and 7 of Annex III in the areas of Error! Post not found for word:law enforcement, migration, asylum and border control management, and high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 2 of Annex III has registered the testing in real world conditions in accordance with Article 71(3) with a Union-wide unique single identification number and with the information specified in Annex IX; the Error! Post not found for word:provider or prospective Error! Post not found for word:provider of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in points 1, 6 and 7 of Annex III in the areas of Error! Post not found for word:law enforcement, migration, asylum and border control management, has registered the testing in real-world conditions in the secure non-public section of the EU database according to Article 49(4), point (d), with a Union-wide unique single identification number and with the information specified therein; the Error! Post not found for word:provider or prospective Error! Post not found for word:provider of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 2 of Annex III has registered the testing in real-world conditions in accordance with Article 49(5);
(d) the Error! Post not found for word:provider or prospective Error! Post not found for word:provider conducting the testing in real world conditions is established in the Union or has appointed a legal representative who is established in the Union;
(e) Error! Post not found for word:data collected and processed for the purpose of the testing in real world conditions shall be transferred to third countries only provided that appropriate and applicable safeguards under Union law are implemented;
(f) the testing in real world conditions does not last longer than necessary to achieve its objectives and in any case not longer than six months, which may be extended for an additional period of six months, Error! Post not found for word:subject to prior notification by the Error! Post not found for word:provider or prospective Error! Post not found for word:deployer to the market surveillance authority, accompanied by an explanation of the need for such an extension;
(g) the Error! Post not found for word:subjects of the testing in real world conditions who are persons belonging to vulnerable groups due to their age or disability, are appropriately protected;
(h) where a Error! Post not found for word:provider or prospective Error! Post not found for word:provider organises the testing in real world conditions in cooperation with one or more Error! Post not found for word:deployers or prospective Error! Post not found for word:deployers, the latter have been informed of all aspects of the testing that are relevant to their decision to participate, and given the relevant instructions for use of the Error! Post not found for word:ai system referred to in Article 13; the Error! Post not found for word:provider or prospective Error! Post not found for word:provider and the Error! Post not found for word:deployer or prospective Error! Post not found for word:deployer shall conclude an agreement specifying their roles and responsibilities with a view to ensuring compliance with the provisions for testing in real world conditions under this Regulation and under other applicable Union and national law;
(i) the Error! Post not found for word:subjects of the testing in real world conditions have given Error! Post not found for word:informed Error! Post not found for word:consent in accordance with Article 61, or in the case of Error! Post not found for word:law enforcement, where the seeking of Error! Post not found for word:informed Error! Post not found for word:consent would prevent the Error! Post not found for word:ai system from being tested, the testing itself and the outcome of the testing in the real world conditions shall not have any negative effect on the Error! Post not found for word:subjects, and their Error! Post not found for word:personal Error! Post not found for word:data shall be deleted after the test is performed;
(j) the testing in real world conditions is effectively overseen by the Error! Post not found for word:provider or prospective Error! Post not found for word:provider, as well as by Error! Post not found for word:deployers or prospective Error! Post not found for word:deployers through persons who are suitably qualified in the relevant field and have the necessary capacity, training and authority to perform their tasks;
(k) the predictions, recommendations or decisions of the Error! Post not found for word:ai system can be effectively reversed and disregarded.
- Any Error! Post not found for word:subjects of the testing in real world conditions, or their legally designated representative, as appropriate, may, without any resulting detriment and without having to provide any justification, withdraw from the testing at any time by revoking their Error! Post not found for word:informed Error! Post not found for word:consent and may request the immediate and permanent deletion of their Error! Post not found for word:personal Error! Post not found for word:data. The withdrawal of the Error! Post not found for word:informed Error! Post not found for word:consent shall not affect the activities already carried out.
- In accordance with Article 75, Member States shall confer on their market surveillance authorities the powers of requiring Error! Post not found for word:providers and prospective Error! Post not found for word:providers to provide information, of carrying out unannounced remote or on-site inspections, and of performing checks on the conduct of the testing in real world conditions and the related high-Error! Post not found for word:risk Error! Post not found for word:ai systems. Market surveillance authorities shall use those powers to ensure the safe development of testing in real world conditions.
- Any Error! Post not found for word:serious Error! Post not found for word:incident identified in the course of the testing in real world conditions shall be reported to the national market surveillance authority in accordance with Article 73. The Error! Post not found for word:provider or prospective Error! Post not found for word:provider shall adopt immediate mitigation measures or, failing that, shall suspend the testing in real world conditions until such mitigation takes place, or otherwise terminate it. The Error! Post not found for word:provider or prospective Error! Post not found for word:provider shall establish a procedure for the prompt recall of the Error! Post not found for word:ai system upon such termination of the testing in real world conditions.
- Error! Post not found for word:providers or prospective Error! Post not found for word:providers shall notify the national market surveillance authority in the Member State where the testing in real world conditions is to be conducted of the suspension or termination of the testing in real world conditions and of the final outcomes.
- The Error! Post not found for word:provider or prospective Error! Post not found for word:provider shall be liable under applicable Union and national liability law for any damage caused in the course of their testing in real world conditions.
Article 61 – Informed consent to participate in testing in real world conditions outside AI regulatory sandboxes
- For the purpose of testing in real world conditions under Article 60, freely-given Error! Post not found for word:informed Error! Post not found for word:consent shall be obtained from the Error! Post not found for word:subjects of testing prior to their participation in such testing and after their having been duly informed with concise, clear, relevant, and understandable information regarding:
(a) the nature and objectives of the testing in real world conditions and the possible inconvenience that may be linked to their participation;
(b) the conditions under which the testing in real world conditions is to be conducted, including the expected duration of the Error! Post not found for word:subject or Error! Post not found for word:subjects’ participation;
(c) their rights, and the guarantees regarding their participation, in particular their right to refuse to participate in, and the right to withdraw from, testing in real world conditions at any time without any resulting detriment and without having to provide any justification;
(d) the arrangements for requesting the reversal or the disregarding of the predictions, recommendations or decisions of the Error! Post not found for word:ai system;
(e) the Union-wide unique single identification number of the testing in real world conditions in accordance with Article 60(4) point (c), and the contact details of the Error! Post not found for word:provider or its legal representative from whom further information can be obtained.
- The Error! Post not found for word:informed Error! Post not found for word:consent shall be dated and documented and a copy shall be given to the Error! Post not found for word:subjects of testing or their legal representative.
Article 62 – Measures for providers and deployers, in particular SMEs, including start-ups
- Member States shall undertake the following actions:
(a) provide SMEs, including start-ups, having a registered office or a branch in the Union, with priority access to the AI regulatory sandboxes, to the extent that they fulfil the eligibility conditions and selection criteria; the priority access shall not preclude other SMEs including start-ups other than those referred to in this paragraph from access to the AI regulatory sandbox, provided that they also fulfil the eligibility conditions and selection criteria;
(b) organise specific awareness raising and training activities on the application of this Regulation tailored to the needs of SMEs including start-ups, Error! Post not found for word:deployers and, as appropriate, local public authorities;
(c) utilise existing dedicated channels and where appropriate, establish new ones for communication with SMEs including start-ups, Error! Post not found for word:deployers, other innovators and, as appropriate, local public authorities to provide advice and respond to queries about the implementation of this Regulation, including as regards participation in AI regulatory sandboxes;
(d) facilitate the participation of SMEs and other relevant stakeholders in the standardisation development process.
- The specific interests and needs of the SME Error! Post not found for word:providers, including start-ups, shall be taken into account when setting the fees for conformity assessment under Article 43, reducing those fees proportionately to their size, market size and other relevant indicators.
- The Error! Post not found for word:ai office shall undertake the following actions:
(a) provide standardised templates for areas covered by this Regulation, as specified by the Board in its request;
(b) develop and maintain a single information platform providing easy to use information in relation to this Regulation for all Error! Post not found for word:operators across the Union;
(c) organise appropriate communication campaigns to raise awareness about the obligations arising from this Regulation;
(d) evaluate and promote the convergence of best practices in public procurement procedures in relation to Error! Post not found for word:ai systems.
Article 63 – Derogations for specific operators
- Microenterprises within the meaning of Recommendation 2003/361/EC, may comply with certain elements of the quality management system required by Article 17 of this Regulation in a simplified manner, provided that they do not have partner enterprises or linked enterprises within the meaning of that Recommendation. For that purpose, the Commission shall develop guidelines on the elements of the quality management system which may be complied with in a simplified manner considering the needs of microenterprises, without affecting the level of protection or the need for compliance with the requirements in respect of high-Error! Post not found for word:risk Error! Post not found for word:ai systems.
- Paragraph 1 of this Article shall not be interpreted as exempting those Error! Post not found for word:operators from fulfilling any other requirements or obligations laid down in this Regulation, including those established in Articles 9, 10, 11, 12, 13, 14, 15, 72 and 73.
CHAPTER VII – GOVERNANCE
Section 1 – Governance at Union level
Article 64 – AI Office
- The Commission shall develop Union expertise and capabilities in the field of AI through the Error! Post not found for word:ai office.
- Member States shall facilitate the tasks entrusted to the Error! Post not found for word:ai office, as reflected in this Regulation.
Article 65 – Establishment and structure of the European Artificial Intelligence Board
- A European Artificial Intelligence Board (the ‘Board’) is hereby established.
- The Board shall be composed of one representative per Member State. The European Error! Post not found for word:data Protection Supervisor shall participate as observer. The Error! Post not found for word:ai office shall also attend the Board’s meetings, without taking part in the votes. Other national and Union authorities, bodies or experts may be invited to the meetings by the Board on a case by case basis, where the issues discussed are of relevance for them.
- Each representative shall be designated by their Member State for a period of three years, renewable once.
- Member States shall ensure that their Error! Post not found for word:representatives on the Board:
(a) have the relevant competences and powers in their Member State so as to contribute actively to the achievement of the Board’s tasks referred to in Article 66;
(b) are designated as a single contact point vis-à-vis the Board and, where appropriate, taking into account Member States’ needs, as a single contact point for stakeholders;
(c) are empowered to facilitate consistency and coordination between national competent authorities in their Member State as regards the implementation of this Regulation, including through the collection of relevant Error! Post not found for word:data and information for the purpose of fulfilling their tasks on the Board.
- The designated Error! Post not found for word:representatives of the Member States shall adopt the Board’s rules of procedure by a two-thirds majority. The rules of procedure shall, in particular, lay down procedures for the selection process, the duration of the mandate of, and specifications of the tasks of, the Chair, detailed arrangements for voting, and the organisation of the Board’s activities and those of its sub-groups.
- The Board shall establish two standing sub-groups to provide a platform for cooperation and exchange among market surveillance authorities and to notifying authorities about issues related to market surveillance and notified bodies respectively.
The standing sub-group for market surveillance should act as the administrative cooperation group (ADCO) for this Regulation within the meaning of Article 30 of Regulation (EU) 2019/1020.
The Board may establish other standing or temporary sub-groups as appropriate for the purpose of examining specific issues. Where appropriate, Error! Post not found for word:representatives of the advisory forum referred to in Article 67 may be invited to such sub-groups or to specific meetings of those subgroups as observers.
- The Board shall be organised and operated so as to safeguard the objectivity and impartiality of its activities.
- The Board shall be chaired by one of the Error! Post not found for word:representatives of the Member States. The Error! Post not found for word:ai office shall provide the secretariat for the Board. convene the meetings upon request of the Chair, and prepare the agenda in accordance with the tasks of the Board pursuant to this Regulation and its rules of procedure.
Article 66 – Tasks of the Board
The Board shall advise and assist the Commission and the Member States in order to facilitate the consistent and effective application of this Regulation. To that end, the Board may in particular:
(a) contribute to the coordination among national competent authorities responsible for the application of this Regulation and, in cooperation with and Error! Post not found for word:subject to the agreement of the market surveillance authorities concerned, support joint activities of market surveillance authorities referred to in Article 74(11);
(b) collect and share technical and regulatory expertise and best practices among Member States;
(c) provide advice on the implementation of this Regulation, in particular as regards the enforcement of rules on general-purpose AI models;
(d) contribute to the harmonisation of administrative practices in the Member States, including in relation to the derogation from the conformity assessment procedures referred to in Article 46, the functioning of AI regulatory sandboxes, and testing in real world conditions referred to in Articles 57, 59 and 60;
(e) at the request of the Commission or on its own initiative, issue recommendations and written opinions on any relevant matters related to the implementation of this Regulation and to its consistent and effective application, including:
(i) on the development and application of Error! Post not found for word:codes of conduct and codes of practice pursuant to this Regulation, as well as of the Commission’s guidelines;
(ii) the evaluation and review of this Regulation pursuant to Article 112, including as regards the Error! Post not found for word:serious Error! Post not found for word:incident reports referred to in Article 73, and the functioning of the EU database referred to in Article 71, the preparation of the delegated or implementing acts, and as regards possible alignments of this Regulation with the Union harmonised legislation listed in Annex I;
(iii) on technical specifications or existing standards regarding the requirements set out in Chapter III, Section 2;
(iv) on the use of harmonised standards or common specifications referred to in Articles 40 and 41;
(v) trends, such as European global competitiveness in AI, the uptake of AI in the Union, and the development of digital skills;
(vi) trends on the evolving typology of AI value chains, in particular on the resulting implications in terms of Error! Post not found for word:accountability;
(vii) on the potential need for amendment to Annex III in accordance with Article 7, and on the potential need for possible revision of Article 5 pursuant to Article 112, taking into account relevant available evidence and the latest developments in technology;
(f) support the Commission in promoting Error! Post not found for word:ai literacy, public awareness and understanding of the benefits, risks, safeguards and rights and obligations in relation to the use of Error! Post not found for word:ai systems;
(g) facilitate the development of common criteria and a shared understanding among market Error! Post not found for word:operators and competent authorities of the relevant concepts provided for in this Regulation, including by contributing to the development of benchmarks;
(h) cooperate, as appropriate, with other Union institutions, bodies, offices and agencies, as well as relevant Union expert groups and networks, in particular in the fields of product safety, Error! Post not found for word:cybersecurity, competition, digital and media services, financial services, Error! Post not found for word:consumer protection, Error! Post not found for word:data and fundamental rights protection;
(i) contribute to effective cooperation with the competent authorities of third countries and with international organisations;
(j) assist national competent authorities and the Commission in developing the organisational and technical expertise required for the implementation of this Regulation, including by contributing to the assessment of training needs for staff of Member States involved in implementing this Regulation;
(k) assist the Error! Post not found for word:ai office in supporting national competent authorities in the establishment and development of AI regulatory sandboxes, and facilitate cooperation and information-sharing among AI regulatory sandboxes;
(l) contribute to, and provide relevant advice on, the development of guidance documents;
(m) advise the Commission in relation to international matters on AI;
(n) provide opinions to the Commission on the qualified alerts regarding general-purpose AI models;
(o) receive opinions by the Member States on qualified alerts regarding general-purpose AI models, and on national experiences and practices on the monitoring and enforcement of Error! Post not found for word:ai systems, in particular systems integrating the general-purpose AI models.
Article 67 – Advisory forum
- An advisory forum shall be established to provide technical expertise and advise the Board and the Commission, and to contribute to their tasks under this Regulation.
- The membership of the advisory forum shall represent a balanced selection of stakeholders, including industry, start-ups, SMEs, civil society and academia. The membership of the advisory forum shall be balanced with regard to commercial and non-commercial interests and, within the category of commercial interests, with regard to SMEs and other Error! Post not found for word:undertakings.
- The Commission shall appoint the members of the advisory forum, in accordance with the criteria set out in paragraph 2, from amongst stakeholders with recognised expertise in the field of AI.
- The term of office of the members of the advisory forum shall be two years, which may be extended by up to no more than four years.
- The Fundamental Rights Agency, ENISA, the European Committee for Standardization (CEN), the European Committee for Electrotechnical Standardization (CENELEC), and the European Telecommunications Standards Institute (ETSI) shall be permanent members of the advisory forum.
- The advisory forum shall draw up its rules of procedure. It shall elect two co-chairs from among its members, in accordance with criteria set out in paragraph 2. The term of office of the co-chairs shall be two years, renewable once.
- The advisory forum shall hold meetings at least twice a year. The advisory forum may invite experts and other stakeholders to its meetings.
- The advisory forum may prepare opinions, recommendations and written contributions at the request of the Board or the Commission.
- The advisory forum may establish standing or temporary sub-groups as appropriate for the purpose of examining specific questions related to the objectives of this Regulation.
- The advisory forum shall prepare an annual report on its activities. That report shall be made publicly available.
Article 68 – Scientific panel of independent experts
- The Commission shall, by means of an implementing act, make provisions on the establishment of a scientific panel of independent experts (the ‘scientific panel’) intended to support the enforcement activities under this Regulation. That implementing act shall be adopted in accordance with the examination procedure referred to in Article 98(2).
- The scientific panel shall consist of experts selected by the Commission on the basis of up-to-date scientific or technical expertise in the field of AI necessary for the tasks set out in paragraph 3, and shall be able to demonstrate meeting all of the following conditions:
(a) having particular expertise and competence and scientific or technical expertise in the field of AI;
(b) independence from any Error! Post not found for word:provider of Error! Post not found for word:ai systems or general-purpose AI models;
(c) an ability to carry out activities diligently, accurately and objectively. The Commission, in consultation with the Board, shall determine the number of experts on the panel in accordance with the required needs and shall ensure fair gender and geographical representation.
- The scientific panel shall advise and support the Error! Post not found for word:ai office, in particular with regard to the following tasks:
(a) supporting the implementation and enforcement of this Regulation as regards general-purpose AI models and systems, in particular by:
(i) alerting the Error! Post not found for word:ai office of possible Error! Post not found for word:systemic risks at Union level of general-purpose AI models, in accordance with Article 90;
(ii) contributing to the development of tools and methodologies for evaluating capabilities of general-purpose AI models and systems, including through benchmarks;
(iii) providing advice on the classification of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk;
(iv) providing advice on the classification of various general-purpose AI models and systems;
(v) contributing to the development of tools and templates;
(b) supporting the work of market surveillance authorities, at their request;
(c) supporting cross-border market surveillance activities as referred to in Article 74(11), without prejudice to the powers of market surveillance authorities;
(d) supporting the Error! Post not found for word:ai office in carrying out its duties in the context of the Union safeguard procedure pursuant to Article 81.
- The experts on the scientific panel shall perform their tasks with impartiality and objectivity, and shall ensure the confidentiality of information and Error! Post not found for word:data obtained in carrying out their tasks and activities. They shall neither seek nor take instructions from anyone when exercising their tasks under paragraph 3. Each expert shall draw up a declaration of interests, which shall be made publicly available. The Error! Post not found for word:ai office shall establish systems and procedures to actively manage and prevent potential conflicts of interest.
- The implementing act referred to in paragraph 1 shall include provisions on the conditions, procedures and detailed arrangements for the scientific panel and its members to issue alerts, and to request the assistance of the Error! Post not found for word:ai office for the performance of the tasks of the scientific panel.
Article 69 – Access to the pool of experts by the Member States
- Member States may call upon experts of the scientific panel to support their enforcement activities under this Regulation.
- The Member States may be required to pay fees for the advice and support provided by the experts. The structure and the level of fees as well as the scale and structure of recoverable costs shall be set out in the implementing act referred to in Article 68(1), taking into account the objectives of the adequate implementation of this Regulation, cost-effectiveness and the necessity of ensuring effective access to experts for all Member States.
- The Commission shall facilitate timely access to the experts by the Member States, as needed, and ensure that the combination of support activities carried out by Union AI testing support pursuant to Article 84 and experts pursuant to this Article is efficiently organised and provides the best possible added value.
Section 2 – National competent authorities
Article 70 – Designation of national competent authorities and single points of contact
- Each Member State shall establish or designate as national competent authorities at least one notifying authority and at least one market surveillance authority for the purposes of this Regulation. Those national competent authorities shall exercise their powers independently, impartially and without bias so as to safeguard the objectivity of their activities and tasks, and to ensure the application and implementation of this Regulation. The members of those authorities shall refrain from any action incompatible with their duties. Provided that those principles are observed, such activities and tasks may be performed by one or more designated authorities, in accordance with the organisational needs of the Member State.
- Member States shall communicate to the Commission the identity of the notifying authorities and the market surveillance authorities and the tasks of those authorities, as well as any subsequent changes thereto. Member States shall make publicly available information on how competent authorities and single points of contact can be contacted, through electronic communication means by 02 August 2025. Member States shall designate a market surveillance authority to act as the single point of contact for this Regulation, and shall notify the Commission of the identity of the single point of contact. The Commission shall make a list of the single points of contact publicly available.
- Member States shall ensure that their national competent authorities are provided with adequate technical, financial and human resources, and with infrastructure to fulfil their tasks effectively under this Regulation. In particular, the national competent authorities shall have a sufficient number of personnel permanently available whose competences and expertise shall include an in-depth understanding of AI technologies, Error! Post not found for word:data and Error! Post not found for word:data computing, Error! Post not found for word:personal Error! Post not found for word:data protection, Error! Post not found for word:cybersecurity, fundamental rights, health and safety risks and knowledge of existing standards and legal requirements. Member States shall assess and, if necessary, update competence and resource requirements referred to in this paragraph on an annual basis.
- National competent authorities shall take appropriate measures to ensure an adequate level of Error! Post not found for word:cybersecurity.
- When performing their tasks, the national competent authorities shall act in accordance with the confidentiality obligations set out in Article 78.
- By 102 August 2025 and once every two years thereafter, Member States shall report to the Commission on the status of the financial and human resources of the national competent authorities, with an assessment of their adequacy. The Commission shall transmit that information to the Board for discussion and possible recommendations.
- The Commission shall facilitate the exchange of experience between national competent authorities.
- National competent authorities may provide guidance and advice on the implementation of this Regulation, in particular to SMEs including start-ups, taking into account the guidance and advice of the Board and the Commission, as appropriate. Whenever national competent authorities intend to provide guidance and advice with regard to an Error! Post not found for word:ai system in areas covered by other Union law, the national competent authorities under that Union law shall be consulted, as appropriate.
- Where Union institutions, bodies, offices or agencies fall within the scope of this Regulation, the European Error! Post not found for word:data Protection Supervisor shall act as the competent authority for their supervision.
CHAPTER VIII – EU DATABASE FOR HIGH-RISK AI SYSTEMS
Article 71 – EU database for high-risk AI systems listed in Annex III
- The Commission shall, in collaboration with the Member States, set up and maintain an EU database containing information referred to in paragraphs 2 and 3 of this Article concerning high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Article 6(2) which are registered in accordance with Articles 49 and 60 and Error! Post not found for word:ai systems that are not considered as high-Error! Post not found for word:risk pursuant to Article 6(3) and which are registered in accordance with Article 6(4) and Article 49. When setting the functional specifications of such database, the Commission shall consult the relevant experts, and when updating the functional specifications of such database, the Commission shall consult the Board.
- The Error! Post not found for word:data listed in Sections A and B of Annex VIII shall be entered into the EU database by the Error! Post not found for word:provider or, where applicable, by the authorised representative.
- The Error! Post not found for word:data listed in Section C of Annex VIII shall be entered into the EU database by the Error! Post not found for word:deployer who is, or who acts on behalf of, a public authority, agency or body, in accordance with Articles 49(3) and (4).
- With the exception of the section referred to in Article 49(4) and Article 60(4), point (c), the information contained in the EU database registered in accordance with Article 49 shall be accessible and publicly available in a Error! Post not found for word:user-friendly manner. The information should be easily navigable and machine-readable. The information registered in accordance with Article 60 shall be accessible only to market surveillance authorities and the Commission, unless the prospective Error! Post not found for word:provider or Error! Post not found for word:provider has given Error! Post not found for word:consent for also making the information accessible the public.
- The EU database shall contain Error! Post not found for word:personal Error! Post not found for word:data only in so far as necessary for collecting and Error! Post not found for word:processing information in accordance with this Regulation. That information shall include the names and contact details of natural persons who are responsible for registering the system and have the legal authority to represent the Error! Post not found for word:provider or the Error! Post not found for word:deployer, as applicable.
- The Commission shall be the Error! Post not found for word:controller of the EU database. It shall make available to Error! Post not found for word:providers, prospective Error! Post not found for word:providers and Error! Post not found for word:deployers adequate technical and administrative support. The EU database shall comply with the applicable accessibility requirements.
CHAPTER IX – POST-MARKET MONITORING, INFORMATION SHARING AND MARKET SURVEILLANCE
Section 1 – Post-market monitoring
Article 72 – Post-market monitoring by providers and post-market monitoring plan for high-risk AI systems
- Error! Post not found for word:providers shall establish and document a post-market monitoring system in a manner that is proportionate to the nature of the AI technologies and the risks of the high-Error! Post not found for word:risk Error! Post not found for word:ai system.
- The post-market monitoring system shall actively and systematically collect, document and analyse relevant Error! Post not found for word:data which may be provided by Error! Post not found for word:deployers or which may be collected through other sources on the performance of high-Error! Post not found for word:risk Error! Post not found for word:ai systems throughout their lifetime, and which allow the Error! Post not found for word:provider to evaluate the continuous compliance of Error! Post not found for word:ai systems with the requirements set out in Chapter III, Section 2. Where relevant, post-market monitoring shall include an analysis of the interaction with other Error! Post not found for word:ai systems. This obligation shall not cover sensitive operational data of Error! Post not found for word:deployers which are law-enforcement authorities.
- The post-market monitoring system shall be based on a post-market monitoring plan. The post-market monitoring plan shall be part of the technical documentation referred to in Annex IV. The Commission shall adopt an implementing act laying down detailed provisions establishing a template for the post-market monitoring plan and the list of elements to be included in the plan by 02 February 2026. That implementing act shall be adopted in accordance with the examination procedure referred to in Article 98(2).
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems covered by the Union harmonisation legislation listed in Section A of Annex I, where a post-market monitoring system and plan are already established under that legislation, in order to ensure consistency, avoid duplications and minimise additional burdens, Error! Post not found for word:providers shall have a choice of integrating, as appropriate, the necessary elements described in paragraphs 1, 2 and 3 using the template referred in paragraph 3 into systems and plans already existing under that legislation, provided that achieves an equivalent level of protection.
The first subparagraph of this paragraph shall also apply to high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 5 of Annex III placed on the market or put into service by financial institutions that are Error! Post not found for word:subject to requirements under Union financial services law regarding their internal governance, arrangements or processes.
Section 2 – Sharing of information on serious incidents
Article 73 – Reporting of serious incidents
- Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems placed on the Union market shall report any Error! Post not found for word:serious Error! Post not found for word:incident to the market surveillance authorities of the Member States where that Error! Post not found for word:incident occurred.
- The report referred to in paragraph 1 shall be made immediately after the Error! Post not found for word:provider has established a causal link between the Error! Post not found for word:ai system and the Error! Post not found for word:serious Error! Post not found for word:incident or the reasonable likelihood of such a link, and, in any event, not later than 15 days after the Error! Post not found for word:provider or, where applicable, the Error! Post not found for word:deployer, becomes aware of the Error! Post not found for word:serious Error! Post not found for word:incident.
The period for the reporting referred to in the first subparagraph shall take account of the severity of the Error! Post not found for word:serious Error! Post not found for word:incident.
- Notwithstanding paragraph 2 of this Article, in the event of a widespread infringement or a Error! Post not found for word:serious Error! Post not found for word:incident as defined in Article 3, point (49) (b), the report referred to in paragraph 1 of this Article shall be provided immediately, and not later than two days after the Error! Post not found for word:provider or, where applicable, the Error! Post not found for word:deployer becomes aware of that Error! Post not found for word:incident.
- Notwithstanding paragraph 2, in the event of the death of a person, the report shall be provided immediately after the Error! Post not found for word:provider or the Error! Post not found for word:deployer has established, or as soon as it suspects, a causal relationship between the high-Error! Post not found for word:risk Error! Post not found for word:ai system and the Error! Post not found for word:serious Error! Post not found for word:incident, but not later than 10 days after the date on which the Error! Post not found for word:provider or, where applicable, the Error! Post not found for word:deployer becomes aware of the Error! Post not found for word:serious Error! Post not found for word:incident.
- Where necessary to ensure timely reporting, the Error! Post not found for word:provider or, where applicable, the Error! Post not found for word:deployer, may submit an initial report that is incomplete, followed by a complete report.
- Following the reporting of a Error! Post not found for word:serious Error! Post not found for word:incident pursuant to paragraph 1, the Error! Post not found for word:provider shall, without delay, perform the necessary investigations in relation to the Error! Post not found for word:serious Error! Post not found for word:incident and the Error! Post not found for word:ai system concerned. This shall include a Error! Post not found for word:risk assessment of the Error! Post not found for word:incident, and corrective action.
The Error! Post not found for word:provider shall cooperate with the competent authorities, and where relevant with the Error! Post not found for word:notified body concerned, during the investigations referred to in the first subparagraph, and shall not perform any investigation which involves altering the Error! Post not found for word:ai system concerned in a way which may affect any subsequent evaluation of the causes of the Error! Post not found for word:incident, prior to informing the competent authorities of such action.
- Upon receiving a notification related to a Error! Post not found for word:serious Error! Post not found for word:incident referred to in Article 3, point (49)(c), the relevant market surveillance authority shall inform the national public authorities or bodies referred to in Article 77(1). The Commission shall develop dedicated guidance to facilitate compliance with the obligations set out in paragraph 1 of this Article. That guidance shall be issued by 02 August 2025, and shall be assessed regularly.
- The market surveillance authority shall take appropriate measures, as provided for in Article 19 of Regulation (EU) 2019/1020, within seven days from the date it received the notification referred to in paragraph 1 of this Article, and shall follow the notification procedures as provided in that Regulation.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Annex III that are placed on the market or put into service by Error! Post not found for word:providers that are Error! Post not found for word:subject to Union legislative instruments laying down reporting obligations equivalent to those set out in this Regulation, the notification of Error! Post not found for word:serious Error! Post not found for word:incidents shall be limited to those referred to in Article 3, point (49)(c).
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems which are safety components of devices, or are themselves devices, covered by Regulations (EU) 2017/745 and (EU) 2017/746, the notification of Error! Post not found for word:serious Error! Post not found for word:incidents shall be limited to those referred to in Article 3, point (44)(c) of this Regulation, and shall be made to the national competent authority chosen for that purpose by the Member States where the Error! Post not found for word:incident occurred.
- National competent authorities shall immediately notify the Commission of any Error! Post not found for word:serious Error! Post not found for word:incident, whether or not it they have taken action on it, in accordance with Article 20 of Regulation (EU) 2019/1020.
Section 3 – Enforcement
Article 74 – Market surveillance and control of AI systems in the Union market
- Regulation (EU) 2019/1020 shall apply to Error! Post not found for word:ai systems covered by this Regulation. For the purposes of the effective enforcement of this Regulation:
(a) any reference to an economic Error! Post not found for word:operator under Regulation (EU) 2019/1020 shall be understood as including all Error! Post not found for word:operators identified in Article 2(1) of this Regulation;
(b) any reference to a product under Regulation (EU) 2019/1020 shall be understood as including all Error! Post not found for word:ai systems falling within the scope of this Regulation.
- As part of their reporting obligations under Article 34(4) of Regulation (EU) 2019/1020, the market surveillance authorities shall report annually to the Commission and relevant national competition authorities any information identified in the course of market surveillance activities that may be of potential interest for the application of Union law on competition rules. They shall also annually report to the Commission about the use of prohibited practices that occurred during that year and about the measures taken.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems related to products covered by the Union harmonisation legislation listed in Section A of Annex I, the market surveillance authority for the purposes of this Regulation shall be the authority responsible for market surveillance activities designated under those Union harmonisation legislation.
By derogation from the first subparagraph, and in appropriate circumstances, Member States may designate another relevant authority to act as a market surveillance authority, provided they ensure coordination with the relevant sectoral market surveillance authorities responsible for the enforcement of the legal acts listed in Annex I. - The procedures referred to in Articles 79 to 83 of this Regulation shall not apply to Error! Post not found for word:ai systems related to products covered by the Union harmonisation legislation listed in section A of Annex I, where such legal acts already provide for procedures ensuring an equivalent level of protection and having the same objective. In such cases, the relevant sectoral procedures shall apply instead.
- Without prejudice to the powers of market surveillance authorities under Article 14 of Regulation (EU) 2019/1020, for the purpose of ensuring the effective enforcement of this Regulation, market surveillance authorities may exercise the powers referred to in Article 14(4), points (d) and (j), of that Regulation remotely, as appropriate.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems placed on the market, put into service, or used by financial institutions regulated by Union financial services law, the market surveillance authority for the purposes of this Regulation shall be the relevant national authority responsible for the financial supervision of those institutions under that legislation in so far as the placing on the market, putting into service, or the use of the Error! Post not found for word:ai system is in direct connection with the provision of those financial services.
- By way of derogation from paragraph 6, in appropriate circumstances, and provided that coordination is ensured, another relevant authority may be identified by the Member State as market surveillance authority for the purposes of this Regulation.
National market surveillance authorities supervising regulated credit institutions regulated under Directive 2013/36/EU, which are participating in the Single Supervisory Mechanism established by Regulation (EU) No 1024/2013, should report, without delay, to the European Central Bank any information identified in the course of their market surveillance activities that may be of potential interest for the prudential supervisory tasks of the European Central Bank specified in that Regulation.
- For high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in point 1 of Annex III of this Regulation, in so far as the systems are used for Error! Post not found for word:law enforcement purposes, border management and justice and democracy, and for high-Error! Post not found for word:risk Error! Post not found for word:ai systems listed in points 6, 7 and 8 of Annex III to this Regulation, Member States shall designate as market surveillance authorities for the purposes of this Regulation either the competent Error! Post not found for word:data protection supervisory authorities under Regulation (EU) 2016/679 or Directive (EU) 2016/680, or any other authority designated pursuant to the same conditions laid down in Articles 41 to 44 of Directive (EU) 2016/680. Market surveillance activities shall in no way affect the independence of judicial authorities, or otherwise interfere with their activities when acting in their judicial capacity.
- Where Union institutions, bodies, offices or agencies fall within the scope of this Regulation, the European Error! Post not found for word:data Protection Supervisor shall act as their market surveillance authority, except in relation to the Court of Justice of the European Union acting in its judicial capacity.
- Member States shall facilitate coordination between market surveillance authorities designated under this Regulation and other relevant national authorities or bodies which supervise the application of Union harmonisation legislation listed in Annex I, or in other Union law, that might be relevant for the high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Annex III.
- Market surveillance authorities and the Commission shall be able to propose joint activities, including joint investigations, to be conducted by either market surveillance authorities or market surveillance authorities jointly with the Commission, that have the aim of promoting compliance, identifying non-compliance, raising awareness or providing guidance in relation to this Regulation with respect to specific categories of high-Error! Post not found for word:risk Error! Post not found for word:ai systems that are found to present a serious Error! Post not found for word:risk across two or more Member States in accordance with Article 9 of Regulation (EU) 2019/1020. The Error! Post not found for word:ai office shall provide coordination support for joint investigations.
- Without prejudice to the powers provided for under Regulation (EU) 2019/1020, and where relevant and limited to what is necessary to fulfil their tasks, the market surveillance authorities shall be granted full access by Error! Post not found for word:providers to the documentation as well as the training, validation and Error! Post not found for word:testing Error! Post not found for word:data sets used for the development of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, including, where appropriate and Error! Post not found for word:subject to security safeguards, through application programming interfaces (‘API’) or other relevant technical means and tools enabling remote access.
- Market surveillance authorities shall be granted access to the source code of the high-Error! Post not found for word:risk Error! Post not found for word:ai system upon a reasoned request and only when both of the following conditions are fulfilled:
(a) access to source code is necessary to assess the conformity of a high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Chapter III, Section 2; and,
(b) testing or auditing procedures and verifications based on the Error! Post not found for word:data and documentation provided by the Error! Post not found for word:provider have been exhausted or proved insufficient.
- Any information or documentation obtained by market surveillance authorities shall be treated in accordance with the confidentiality obligations set out in Article 78.
Article 75 – Mutual assistance, market surveillance and control of general-purpose AI systems
- Where an Error! Post not found for word:ai system is based on a general-purpose AI model, and the model and the system are developed by the same Error! Post not found for word:provider, the Error! Post not found for word:ai office shall have powers to monitor and supervise compliance of that Error! Post not found for word:ai system with obligations under this Regulation. To carry out its monitoring and supervision tasks, the Error! Post not found for word:ai office shall have all the powers of a market surveillance authority provided for in this Section and Regulation (EU) 2019/1020.
- Where the relevant market surveillance authorities have sufficient reason to consider general-purpose AI systems that can be used directly by Error! Post not found for word:deployers for at least one purpose that is classified as high-Error! Post not found for word:risk pursuant to this Regulation to be non-compliant with the requirements laid down in this Regulation, they shall cooperate with the Error! Post not found for word:ai office to carry out compliance evaluations, and shall inform the Board and other market surveillance authorities accordingly.
- Where a market surveillance authority is unable to conclude its investigation of the high-Error! Post not found for word:risk Error! Post not found for word:ai system because of its inability to access certain information related to the general-purpose AI model despite having made all appropriate efforts to obtain that information, it may submit a reasoned request to the Error! Post not found for word:ai office, by which access to that information shall be enforced. In that case, the Error! Post not found for word:ai office shall supply to the applicant authority without delay, and in any event within 30 days, any information that the Error! Post not found for word:ai office considers to be relevant in order to establish whether a high-Error! Post not found for word:risk Error! Post not found for word:ai system is non-compliant. Market surveillance authorities shall safeguard the confidentiality of the information they obtain in accordance with Article 78 of this Regulation. The procedure provided for in Chapter VI of Regulation (EU) 2019/1020 shall apply mutatis mutandis.
Article 76 – Supervision of testing in real world conditions by market surveillance authorities
- Market surveillance authorities shall have competences and powers to ensure that testing in real world conditions is in accordance with this Regulation.
- Where testing in real world conditions is conducted for Error! Post not found for word:ai systems that are supervised within an AI regulatory sandbox under Article 58, the market surveillance authorities shall verify the compliance with Article 60 as part of their supervisory role for the AI regulatory sandbox. Those authorities may, as appropriate, allow the testing in real world conditions to be conducted by the Error! Post not found for word:provider or prospective Error! Post not found for word:provider, in derogation from the conditions set out in Article 60(4), points (f) and (g).
- Where a market surveillance authority has been informed by the prospective Error! Post not found for word:provider, the Error! Post not found for word:provider or any Error! Post not found for word:third party of a Error! Post not found for word:serious Error! Post not found for word:incident or has other grounds for considering that the conditions set out in Articles 60 and 61 are not met, it may take either of the following decisions on its territory, as appropriate:
(a) to suspend or terminate the testing in real world conditions;
(b) to require the Error! Post not found for word:provider or prospective Error! Post not found for word:provider and the Error! Post not found for word:deployer and prospective Error! Post not found for word:deployer to modify any aspect of the testing in real world conditions.
- Where a market surveillance authority has taken a decision referred to in paragraph 3 of this Article, or has issued an objection within the meaning of Article 60(4), point (b), the decision or the objection shall indicate the grounds therefor and how the Error! Post not found for word:provider or prospective Error! Post not found for word:provider can challenge the decision or objection.
- Where applicable, where a market surveillance authority has taken a decision referred to in paragraph 3, it shall communicate the grounds therefor to the market surveillance authorities of other Member States in which the Error! Post not found for word:ai system has been tested in accordance with the testing plan.
Article 77 – Powers of authorities protecting fundamental rights
- National public authorities or bodies which supervise or enforce the respect of obligations under Union law protecting fundamental rights, including the right to non-discrimination, in relation to the use of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in Annex III shall have the power to request and access any documentation created or maintained under this Regulation in accessible language and format when access to that documentation is necessary for effectively fulfilling their mandates within the limits of their jurisdiction. The relevant public authority or body shall inform the market surveillance authority of the Member State concerned of any such request.
- By 02 November 2024, each Member State shall identify the public authorities or bodies referred to in paragraph 1 and make a list of them publicly available. Member States shall notify the list to the Commission and to the other Member States, and shall keep the list up to date.
- Where the documentation referred to in paragraph 1 is insufficient to ascertain whether an infringement of obligations under Union law protecting fundamental rights has occurred, the public authority or body referred to in paragraph 1 may make a reasoned request to the market surveillance authority, to organise testing of the high-Error! Post not found for word:risk Error! Post not found for word:ai system through technical means. The market surveillance authority shall organise the testing with the close involvement of the requesting public authority or body within a reasonable time following the request.
- Any information or documentation obtained by the national public authorities or bodies referred to in paragraph 1 of this Article pursuant to this Article shall be treated in accordance with the confidentiality obligations set out in Article 78.
Article 78 – Confidentiality
- The Commission, market surveillance authorities and notified bodies and any other natural or legal person involved in the application of this Regulation shall, in accordance with Union or national law, respect the confidentiality of information and Error! Post not found for word:data obtained in carrying out their tasks and activities in such a manner as to protect, in particular:
(a) the intellectual property rights and confidential business information or trade secrets of a natural or legal person, including source code, except in the cases referred to in Article 5 of Directive (EU) 2016/943 of the European Parliament and of the Council (57);
(b) the effective implementation of this Regulation, in particular for the purposes of inspections, investigations or audits;
(c) public and national security interests;
(d) the conduct of criminal or administrative proceedings;
(e) information classified pursuant to Union or national law.
- The authorities involved in the application of this Regulation pursuant to paragraph 1 shall request only Error! Post not found for word:data that is strictly necessary for the assessment of the Error! Post not found for word:risk posed by Error! Post not found for word:ai systems and for the exercise of their powers in accordance with this Regulation and with Regulation (EU) 2019/1020. They shall put in place adequate and effective Error! Post not found for word:cybersecurity measures to protect the security and confidentiality of the information and Error! Post not found for word:data obtained, and shall delete the Error! Post not found for word:data collected as soon as it is no longer needed for the purpose for which it was obtained, in accordance with applicable Union or national law.
- Without prejudice to paragraphs 1 and 2, information exchanged on a confidential basis between the national competent authorities or between national competent authorities and the Commission shall not be disclosed without prior consultation of the originating national competent authority and the Error! Post not found for word:deployer when high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 1, 6 or 7 of Annex III are used by Error! Post not found for word:law enforcement, border control, immigration or asylum authorities and when such disclosure would jeopardise public and national security interests. This exchange of information shall not cover sensitive operational data in relation to the activities of Error! Post not found for word:law enforcement, border control, immigration or asylum authorities.
When the Error! Post not found for word:law enforcement, immigration or asylum authorities are Error! Post not found for word:providers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems referred to in point 1, 6 or 7 of Annex III, the technical documentation referred to in Annex IV shall remain within the premises of those authorities. Those authorities shall ensure that the market surveillance authorities referred to in Article 74(8) and (9), as applicable, can, upon request, immediately access the documentation or obtain a copy thereof. Only staff of the market surveillance authority holding the appropriate level of security clearance shall be allowed to access that documentation or any copy thereof.
- Paragraphs 1, 2 and 3 shall not affect the rights or obligations of the Commission, Member States and their relevant authorities, as well as those of notified bodies, with regard to the exchange of information and the dissemination of warnings, including in the context of cross-border cooperation, nor shall they affect the obligations of the parties concerned to provide information under criminal law of the Member States.
- The Commission and Member States may exchange, where necessary and in accordance with relevant provisions of international and trade agreements, confidential information with regulatory authorities of third countries with which they have concluded bilateral or multilateral confidentiality arrangements guaranteeing an adequate level of confidentiality.
Article 79 – Procedure at national level for dealing with AI systems presenting a risk
- Error! Post not found for word:ai systems presenting a Error! Post not found for word:risk shall be understood as a “product presenting a Error! Post not found for word:risk” as defined in Article 3, point 19 of Regulation (EU) 2019/1020, in so far as they present risks to the health or safety, or to fundamental rights, of persons.
- Where the market surveillance authority of a Member State has sufficient reason to consider an Error! Post not found for word:ai system to present a Error! Post not found for word:risk as referred to in paragraph 1 of this Article, it shall carry out an evaluation of the Error! Post not found for word:ai system concerned in respect of its compliance with all the requirements and obligations laid down in this Regulation. Particular attention shall be given to Error! Post not found for word:ai systems presenting a Error! Post not found for word:risk to vulnerable groups. Where risks to fundamental rights are identified, the market surveillance authority shall also inform and fully cooperate with the relevant national public authorities or bodies referred to in Article 77(1). The relevant Error! Post not found for word:operators shall cooperate as necessary with the market surveillance authority and with the other national public authorities or bodies referred to in Article 77(1).
Where, in the course of that evaluation, the market surveillance authority or, where applicable the market surveillance authority in cooperation with the national public authority referred to in Article 77(1), finds that the Error! Post not found for word:ai system does not comply with the requirements and obligations laid down in this Regulation, it shall without undue delay require the relevant Error! Post not found for word:operator to take all appropriate corrective actions to bring the Error! Post not found for word:ai system into compliance, to withdraw the Error! Post not found for word:ai system from the market, or to recall it within a period the market surveillance authority may prescribe, and in any event within the shorter of 15 working days, or as provided for in the relevant Union harmonisation legislation.
The market surveillance authority shall inform the relevant Error! Post not found for word:notified body accordingly. Article 18 of Regulation (EU) 2019/1020 shall apply to the measures referred to in the second subparagraph of this paragraph.
- Where the market surveillance authority considers that the non-compliance is not restricted to its national territory, it shall inform the Commission and the other Member States without undue delay of the results of the evaluation and of the actions which it has required the Error! Post not found for word:operator to take.
- The Error! Post not found for word:operator shall ensure that all appropriate corrective action is taken in respect of all the Error! Post not found for word:ai systems concerned that it has made available on the Union market.
- Where the Error! Post not found for word:operator of an Error! Post not found for word:ai system does not take adequate corrective action within the period referred to in paragraph 2, the market surveillance authority shall take all appropriate provisional measures to prohibit or restrict the Error! Post not found for word:ai system’s being made available on its national market or put into service, to withdraw the product or the standalone Error! Post not found for word:ai system from that market or to recall it. That authority shall without undue delay notify the Commission and the other Member States of those measures.
- The notification referred to in paragraph 5 shall include all available details, in particular the information necessary for the identification of the non-compliant Error! Post not found for word:ai system, the origin of the Error! Post not found for word:ai system and the supply chain, the nature of the non-compliance alleged and the Error! Post not found for word:risk involved, the nature and duration of the national measures taken and the arguments put forward by the relevant Error! Post not found for word:operator. In particular, the market surveillance authorities shall indicate whether the non-compliance is due to one or more of the following:
(a) non-compliance with the prohibition of the AI practices referred to in Article 5;
(b) a failure of a high-Error! Post not found for word:risk Error! Post not found for word:ai system to meet requirements set out in Chapter III, Section 2;
(c) shortcomings in the harmonised standards or common specifications referred to in Articles 40 and 41 conferring a presumption of conformity;
(d) non-compliance with Article 50.
- The market surveillance authorities other than the market surveillance authority of the Member State initiating the procedure shall, without undue delay, inform the Commission and the other Member States of any measures adopted and of any additional information at their disposal relating to the non-compliance of the Error! Post not found for word:ai system concerned, and, in the event of disagreement with the notified national measure, of their objections.
- Where, within three months of receipt of the notification referred to in paragraph 5 of this Article, no objection has been raised by either a market surveillance authority of a Member State or by the Commission in respect of a provisional measure taken by a market surveillance authority of another Member State, that measure shall be deemed justified. This shall be without prejudice to the procedural rights of the concerned Error! Post not found for word:operator in accordance with Article 18 of Regulation (EU) 2019/1020. The three-month period referred to in this paragraph shall be reduced to 30 days in the event of non-compliance with the prohibition of the AI practices referred to in Article 5 of this Regulation.
- The market surveillance authorities shall ensure that appropriate restrictive measures are taken in respect of the product or the Error! Post not found for word:ai system concerned, such as withdrawal of the product or the Error! Post not found for word:ai system from their market, without undue delay.
Article 80 – Procedure for dealing with AI systems classified by the provider as non-high-risk in application of Annex III
- Where a market surveillance authority has sufficient reason to consider that an Error! Post not found for word:ai system classified by the Error! Post not found for word:provider as non-high-Error! Post not found for word:risk pursuant to Article 6(3)I is indeed high-Error! Post not found for word:risk, the market surveillance authority shall carry out an evaluation of the Error! Post not found for word:ai system concerned in respect of its classification as a high-Error! Post not found for word:risk Error! Post not found for word:ai system based on the conditions set out in Article 6(3) and the Commission guidelines.
- Where, in the course of that evaluation, the market surveillance authority finds that the Error! Post not found for word:ai system concerned is high-Error! Post not found for word:risk, it shall without undue delay require the relevant Error! Post not found for word:provider to take all necessary actions to bring the Error! Post not found for word:ai system into compliance with the requirements and obligations laid down in this Regulation, as well as take appropriate corrective action within a period the market surveillance authority may prescribe.
- Where the market surveillance authority considers that the use of the Error! Post not found for word:ai system concerned is not restricted to its national territory, it shall inform the Commission and the other Member States without undue delay of the results of the evaluation and of the actions which it has required the Error! Post not found for word:provider to take.
- The Error! Post not found for word:provider shall ensure that all necessary action is taken to bring the Error! Post not found for word:ai system into compliance with the requirements and obligations laid down in this Regulation. Where the Error! Post not found for word:provider of an Error! Post not found for word:ai system concerned does not bring the Error! Post not found for word:ai system into compliance with those requirements and obligations within the period referred to in paragraph 2 of this Article, the Error! Post not found for word:provider shall be Error! Post not found for word:subject to fines in accordance with Article 99.
- The Error! Post not found for word:provider shall ensure that all appropriate corrective action is taken in respect of all the Error! Post not found for word:ai systems concerned that it has made available on the Union market.
- Where the Error! Post not found for word:provider of the Error! Post not found for word:ai system concerned does not take adequate corrective action within the period referred to in paragraph 2 of this Article, Article 79(5) to (9) shall apply.
- Where, in the course of the evaluation pursuant to paragraph 1 of this Article, the market surveillance authority establishes that the Error! Post not found for word:ai system was misclassified by the Error! Post not found for word:provider as non-high-Error! Post not found for word:risk in order to circumvent the application of requirements in Chapter III, Section 2, the Error! Post not found for word:provider shall be Error! Post not found for word:subject to fines in accordance with Article 99.
- In exercising their power to monitor the application of this Article, and in accordance with Article 11 of Regulation (EU) 2019/1020, market surveillance authorities may perform appropriate checks, taking into account in particular information stored in the EU database referred to in Article 71 of this Regulation.
Article 81 – Union safeguard procedure
- Where, within three months of receipt of the notification referred to in Article 79(5), or within 30 days in the case of non-compliance with the prohibition of the AI practices referred to in Article 5, objections are raised by the market surveillance authority of a Member State to a measure taken by another market surveillance authority, or where the Commission considers the measure to be contrary to Union law, the Commission shall without undue delay enter into consultation with the market surveillance authority of the relevant Member State and the Error! Post not found for word:operator or Error! Post not found for word:operators, and shall evaluate the national measure. On the basis of the results of that evaluation, the Commission shall, within six months, or within 60 days in the case of non-compliance with the prohibition of the AI practices referred to in Article 5, starting from the notification referred to in Article 79(5), decide whether the national measure is justified and shall notify its decision to the market surveillance authority of the Member State concerned. The Commission shall also inform all other market surveillance authorities of its decision.
- Where the Commission considers the measure taken by the relevant Member State to be justified, all Member States shall ensure that they take appropriate restrictive measures in respect of the Error! Post not found for word:ai system concerned, such as requiring the withdrawal of the Error! Post not found for word:ai system from their market without undue delay, and shall inform the Commission accordingly. Where the Commission considers the national measure to be unjustified, the Member State concerned shall withdraw the measure and shall inform the Commission accordingly.
- Where the national measure is considered justified and the non-compliance of the Error! Post not found for word:ai system is attributed to shortcomings in the harmonised standards or common specifications referred to in Articles 40 and 41 of this Regulation, the Commission shall apply the procedure provided for in Article 11 of Regulation (EU) No 1025/2012.
Article 82 – Compliant AI systems which present a risk
- Where, having performed an evaluation under Article 79, after consulting the relevant national public authority referred to in Article 77(1), the market surveillance authority of a Member State finds that although a high-Error! Post not found for word:risk Error! Post not found for word:ai system complies with this Regulation, it nevertheless presents a Error! Post not found for word:risk to the health or safety of persons, to fundamental rights, or to other aspects of public interest protection, it shall require the relevant Error! Post not found for word:operator to take all appropriate measures to ensure that the Error! Post not found for word:ai system concerned, when placed on the market or put into service, no longer presents that Error! Post not found for word:risk without undue delay, within a period it may prescribe.
- The Error! Post not found for word:provider or other relevant Error! Post not found for word:operator shall ensure that corrective action is taken in respect of all the Error! Post not found for word:ai systems concerned that it has made available on the Union market within the timeline prescribed by the market surveillance authority of the Member State referred to in paragraph 1.
- The Member States shall immediately inform the Commission and the other Member States of a finding under paragraph 1. That information shall include all available details, in particular the Error! Post not found for word:data necessary for the identification of the Error! Post not found for word:ai system concerned, the origin and the supply chain of the Error! Post not found for word:ai system, the nature of the Error! Post not found for word:risk involved and the nature and duration of the national measures taken.
- The Commission shall without undue delay enter into consultation with the Member States concerned and the relevant Error! Post not found for word:operators, and shall evaluate the national measures taken. On the basis of the results of that evaluation, the Commission shall decide whether the measure is justified and, where necessary, propose other appropriate measures.
- The Commission shall immediately communicate its decision to the Member States concerned and to the relevant Error! Post not found for word:operators. It shall also inform the other Member States.
Article 83 – Formal non-compliance
- Where the market surveillance authority of a Member State makes one of the following findings, it shall require the relevant Error! Post not found for word:provider to put an end to the non-compliance concerned, within a period it may prescribe:
(a) a Error! Post not found for word:ce marking has been affixed in violation of Article 48;
(b) a Error! Post not found for word:ce marking has not been affixed;
(c) a EU declaration of conformity referred to in Article 47 has not been drawn up;
(d) a EU declaration of conformity referred to in Article 47 has not been drawn up correctly;
(e) registration in the EU database referred to in Article 71 has not been carried out;
(f) where applicable, no authorised representative has been appointed;
(g) technical documentation is not available.
- Where the non-compliance referred to in paragraph 1 persists, the market surveillance authority of the Member State concerned shall take appropriate and proportionate measures to restrict or prohibit the high-Error! Post not found for word:risk Error! Post not found for word:ai system being made available on the market or to ensure that it is recalled or withdrawn from the market without delay.
Article 84 – Union AI testing support structures
- The Commission shall designate one or more Union AI testing support structures to perform the tasks listed under Article 21(6) of Regulation (EU) 2019/1020 in the area of AI.
- Without prejudice to the tasks referred to in paragraph 1, Union AI testing support structures shall also provide independent technical or scientific advice at the request of the Board, the Commission, or of market surveillance authorities.
Section 4 – Remedies
Article 85 – Right to lodge a complaint with a market surveillance authority
Without prejudice to other administrative or judicial remedies, any natural or legal person having grounds to consider that there has been an infringement of the provisions of this Regulation may submit complaints to the relevant market surveillance authority.
In accordance with Regulation (EU) 2019/1020, such complaints shall be taken into account for the purpose of conducting market surveillance activities, and shall be handled in line with the dedicated procedures established therefor by the market surveillance authorities.
Article 86 – Right to explanation of individual decision-making
- Any affected person Error! Post not found for word:subject to a decision which is taken by the Error! Post not found for word:deployer on the basis of the output from a high-Error! Post not found for word:risk Error! Post not found for word:ai system listed in Annex III, with the exception of systems listed under point 2 thereof, and which produces legal effects or similarly significantly affects that person in a way that they consider to have an adverse impact on their health, safety or fundamental rights shall have the right to obtain from the Error! Post not found for word:deployer clear and meaningful explanations of the role of the Error! Post not found for word:ai system in the decision-making procedure and the main elements of the decision taken.
- Paragraph 1 shall not apply to the use of Error! Post not found for word:ai systems for which exceptions from, or restrictions to, the obligation under that paragraph follow from Union or national law in compliance with Union law.
- This Article shall apply only to the extent that the right referred to in paragraph 1 is not otherwise provided for under Union law.
Article 87 – Reporting of infringements and protection of reporting persons
Directive (EU) 2019/1937 shall apply to the reporting of infringements of this Regulation and the protection of persons reporting such infringements.
Section 5 – Supervision, investigation, enforcement and monitoring in respect of Error! Post not found for word:providers of general-purpose AI models
Article 88 – Enforcement of the obligations of providers of general-purpose AI models
- The Commission shall have exclusive powers to supervise and enforce Chapter V, taking into account the procedural guarantees under Article 94. The Commission shall entrust the implementation of these tasks to the Error! Post not found for word:ai office, without prejudice to the powers of organisation of the Commission and the division of competences between Member States and the Union based on the Treaties.
- Without prejudice to Article 75(3), market surveillance authorities may request the Commission to exercise the powers laid down in this Section, where that is necessary and proportionate to assist with the fulfilment of their tasks under this Regulation.
Article 89 – Monitoring actions
- For the purpose of carrying out the tasks assigned to it under this Section, the Error! Post not found for word:ai office may take the necessary actions to monitor the effective implementation and compliance with this Regulation by Error! Post not found for word:providers of general-purpose AI models, including their adherence to approved codes of practice.
- Downstream providers shall have the right to lodge a complaint alleging an infringement of this Regulation. A complaint shall be duly reasoned and indicate at least:
(a) the point of contact of the Error! Post not found for word:provider of the general-purpose AI model concerned;
(b) a description of the relevant facts, the provisions of this Regulation concerned, and the reason why the downstream provider considers that the Error! Post not found for word:provider of the general-purpose AI model concerned infringed this Regulation;
(c) any other information that the downstream provider that sent the request considers relevant, including, where appropriate, information gathered on its own initiative.
Article 90 – Alerts of systemic risks by the scientific panel
- The scientific panel may provide a qualified alert to the Error! Post not found for word:ai office where it has reason to suspect that:
(a) a general-purpose AI model poses concrete identifiable Error! Post not found for word:risk at Union level; or,
(b) a general-purpose AI model meets the conditions referred to in Article 51.
- Upon such qualified alert, the Commission, through the Error! Post not found for word:ai office and after having informed the Board, may exercise the powers laid down in this Section for the purpose of assessing the matter. The Error! Post not found for word:ai office shall inform the Board of any measure according to Articles 91 to 94.
- A qualified alert shall be duly reasoned and indicate at least:
(a) the point of contact of the Error! Post not found for word:provider of the general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk concerned;
(b) a description of the relevant facts and the reasons for the alert by the scientific panel;
(c) any other information that the scientific panel considers to be relevant, including, where appropriate, information gathered on its own initiative.
Article 91 – Power to request documentation and information
- The Commission may request the Error! Post not found for word:provider of the general-purpose AI model concerned to provide the documentation drawn up by the Error! Post not found for word:provider in accordance with Articles 53 and 55, or any additional information that is necessary for the purpose of assessing compliance of the Error! Post not found for word:provider with this Regulation.
- Before sending the request for information, the Error! Post not found for word:ai office may initiate a structured dialogue with the Error! Post not found for word:provider of the general-purpose AI model.
- Upon a duly substantiated request from the scientific panel, the Commission may issue a request for information to a Error! Post not found for word:provider of a general-purpose AI model, where the access to information is necessary and proportionate for the fulfilment of the tasks of the scientific panel under Article 68(2).
- The request for information shall state the legal basis and the purpose of the request, specify what information is required, set a period within which the information is to be provided, and indicate the fines provided for in Article 101 for supplying incorrect, incomplete or misleading information.
- The Error! Post not found for word:provider of the general-purpose AI model concerned, or its representative shall supply the information requested. In the case of legal persons, companies or firms, or where the Error! Post not found for word:provider has no legal personality, the persons authorised to represent them by law or by their statutes, shall supply the information requested on behalf of the Error! Post not found for word:provider of the general-purpose AI model concerned. Lawyers duly authorised to act may supply information on behalf of their clients. The clients shall nevertheless remain fully responsible if the information supplied is incomplete, incorrect or misleading.
Article 92 – Power to conduct evaluations
- The Error! Post not found for word:ai office, after consulting the Board, may conduct evaluations of the general-purpose AI model concerned:
(a) to assess compliance of the Error! Post not found for word:provider with obligations under this Regulation, where the information gathered pursuant to Article 91 is insufficient; or,
(b) to investigate Error! Post not found for word:systemic risks at Union level of general-purpose AI models with Error! Post not found for word:systemic Error! Post not found for word:risk, in particular following a qualified alert from the scientific panel in accordance with Article 90(1), point (a).
- The Commission may decide to appoint independent experts to carry out evaluations on its behalf, including from the scientific panel established pursuant to Article 68. Independent experts appointed for this task shall meet the criteria outlined in Article 68(2).
- For the purposes of paragraph 1, the Commission may request access to the general-purpose AI model concerned through APIs or further appropriate technical means and tools, including source code.
- The request for access shall state the legal basis, the purpose and reasons of the request and set the period within which the access is to be provided, and the fines provided for in Article 101 for failure to provide access.
- The Error! Post not found for word:providers of the general-purpose AI model concerned or its representative shall supply the information requested. In the case of legal persons, companies or firms, or where the Error! Post not found for word:provider has no legal personality, the persons authorised to represent them by law or by their statutes, shall provide the access requested on behalf of the Error! Post not found for word:provider of the general-purpose AI model concerned.
- The Commission shall adopt implementing acts setting out the detailed arrangements and the conditions for the evaluations, including the detailed arrangements for involving independent experts, and the procedure for the selection thereof. Those implementing acts shall be adopted in accordance with the examination procedure referred to in Article 98(2).
- Prior to requesting access to the general-purpose AI model concerned, the Error! Post not found for word:ai office may initiate a structured dialogue with the Error! Post not found for word:provider of the general-purpose AI model to gather more information on the internal testing of the model, internal safeguards for preventing Error! Post not found for word:systemic risks, and other internal procedures and measures the Error! Post not found for word:provider has taken to mitigate such risks.
Article 93 – Power to request measures
- Where necessary and appropriate, the Commission may request Error! Post not found for word:providers to:
(a) take appropriate measures to comply with the obligations set out in Articles 53 and 54;
(b) implement mitigation measures, where the evaluation carried out in accordance with Article 92 has given rise to serious and substantiated concern of a Error! Post not found for word:systemic Error! Post not found for word:risk at Union level;
(c) restrict the making available on the market, withdraw or recall the model.
- Before a measure is requested, the Error! Post not found for word:ai office may initiate a structured dialogue with the Error! Post not found for word:provider of the general-purpose AI model.
- If, during the structured dialogue referred to in paragraph 2, the Error! Post not found for word:provider of the general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk offers commitments to implement mitigation measures to address a Error! Post not found for word:systemic Error! Post not found for word:risk at Union level, the Commission may, by decision, make those commitments binding and declare that there are no further grounds for action.
Article 94 – Procedural rights of economic operators of the general-purpose AI model
Article 18 of Regulation (EU) 2019/1020 shall apply mutatis mutandis to the Error! Post not found for word:providers of the general-purpose AI model, without prejudice to more specific procedural rights provided for in this Regulation.
CHAPTER X – CODES OF CONDUCT AND GUIDELINES
Article 95 – Codes of conduct for voluntary application of specific requirements
- The Error! Post not found for word:ai office and the Member States shall encourage and facilitate the drawing up of Error! Post not found for word:codes of conduct, including related governance mechanisms, intended to foster the voluntary application to Error! Post not found for word:ai systems, other than high-Error! Post not found for word:risk Error! Post not found for word:ai systems, of some or all of the requirements set out in Chapter III, Section 2 taking into account the available technical solutions and industry best practices allowing for the application of such requirements.
- The Error! Post not found for word:ai office and the Member States shall facilitate the drawing up of Error! Post not found for word:codes of conduct concerning the voluntary application, including by Error! Post not found for word:deployers, of specific requirements to all Error! Post not found for word:ai systems, on the basis of clear objectives and key performance indicators to measure the achievement of those objectives, including elements such as, but not limited to:
(a) applicable elements provided for in Union ethical guidelines for trustworthy AI;
(b) assessing and minimising the impact of Error! Post not found for word:ai systems on environmental sustainability, including as regards energy-efficient programming and techniques for the efficient design, training and use of AI;
(c) promoting Error! Post not found for word:ai literacy, in particular that of persons dealing with the development, operation and use of AI;
(d) facilitating an inclusive and diverse design of Error! Post not found for word:ai systems, including through the establishment of inclusive and diverse development teams and the promotion of stakeholders’ participation in that process;
(e) assessing and preventing the negative impact of Error! Post not found for word:ai systems on vulnerable persons or groups of vulnerable persons, including as regards accessibility for persons with a disability, as well as on gender equality.
- Error! Post not found for word:codes of conduct may be drawn up by individual Error! Post not found for word:providers or Error! Post not found for word:deployers of Error! Post not found for word:ai systems or by organisations representing them or by both, including with the involvement of any interested stakeholders and their representative organisations, including civil society organisations and academia. Error! Post not found for word:codes of conduct may cover one or more Error! Post not found for word:ai systems taking into account the similarity of the Error! Post not found for word:intended purpose of the relevant systems.
- The Error! Post not found for word:ai office and the Member States shall take into account the specific interests and needs of SMEs, including start-ups, when encouraging and facilitating the drawing up of Error! Post not found for word:codes of conduct.
Article 96 – Guidelines from the Commission on the implementation of this Regulation
- The Commission shall develop guidelines on the practical implementation of this Regulation, and in particular on:
(a) the application of the requirements and obligations referred to in Articles 8 to 15 and in Article 25;
(b) the prohibited practices referred to in Article 5;
(c) the practical implementation of the provisions related to substantial modification;
(d) the practical implementation of transparency obligations laid down in Article 50;
(e) detailed information on the relationship of this Regulation with the Union harmonisation legislation listed in Annex I, as well as with other relevant Union law, including as regards consistency in their enforcement;
(f) the application of the definition of an Error! Post not found for word:ai system as set out in Article 3, point (1).
When issuing such guidelines, the Commission shall pay particular attention to the needs of SMEs including start-ups, of local public authorities and of the sectors most likely to be affected by this Regulation.
The guidelines referred to in the first subparagraph of this paragraph shall take due account of the generally acknowledged state of the art on AI, as well as of relevant harmonised standards and common specifications that are referred to in Articles 40 and 41, or of those harmonised standards or technical specifications that are set out pursuant to Union harmonisation law.
- At the request of the Member States or the Error! Post not found for word:ai office, or on its own initiative, the Commission shall update guidelines previously adopted when deemed necessary.
CHAPTER XI – DELEGATION OF POWER AND COMMITTEE PROCEDURE
Article 97 – Exercise of the delegation
- The power to adopt delegated acts is conferred on the Commission Error! Post not found for word:subject to the conditions laid down in this Article.
- The power to adopt delegated acts referred to in Article 6(6) and (7), Article 7(1) and (3), Article 11(3), Article 43(5) and (6), Article 47(5), Article 51(3), Article 52(4) and Article 53(5) and (6) shall be conferred on the Commission for a period of five years from 01 August 2024. The Commission shall draw up a report in respect of the delegation of power not later than nine months before the end of the five-year period. The delegation of power shall be tacitly extended for periods of an identical duration, unless the European Parliament or the Council opposes such extension not later than three months before the end of each period.
- The delegation of power referred to in Article 6(6) and (7), Article 7(1) and (3), Article 11(3), Article 43(5) and (6), Article 47(5), Article 51(3), Article 52(4) and Article 53(5) and (6) may be revoked at any time by the European Parliament or by the Council. A decision of revocation shall put an end to the delegation of power specified in that decision. It shall take effect the day following that of its publication in the Official Journal of the European Union or at a later date specified therein. It shall not affect the validity of any delegated acts already in force.
- Before adopting a delegated act, the Commission shall consult experts designated by each Member State in accordance with the principles laid down in the Interinstitutional Agreement of 13 April 2016 on Better Law-Making.
- As soon as it adopts a delegated act, the Commission shall notify it simultaneously to the European Parliament and to the Council.
- Any delegated act adopted pursuant to Article 6(6) and (7), Article 7(1) or (3), Article 11(3), Article 43(5) or (6), Article 47(5), Article 51(3), Article 52(4) and Article 53(5) or (6) shall enter into force only if no objection has been expressed by either the European Parliament or the Council within a period of three months of notification of that act to the European Parliament and the Council or if, before the expiry of that period, the European Parliament and the Council have both informed the Commission that they will not object. That period shall be extended by three months at the initiative of the European Parliament or of the Council.
Article 98 – Committee procedure
- The Commission shall be assisted by a committee. That committee shall be a committee within the meaning of Regulation (EU) No 182/2011.
- Where reference is made to this paragraph, Article 5 of Regulation (EU) No 182/2011 shall apply.
CHAPTER XII – PENALTIES
Article 99 – Penalties
- In accordance with the terms and conditions laid down in this Regulation, Member States shall lay down the rules on penalties and other enforcement measures, which may also include warnings and non-monetary measures, applicable to infringements of this Regulation by Error! Post not found for word:operators, and shall take all measures necessary to ensure that they are properly and effectively implemented, thereby taking into account the guidelines issued by the Commission pursuant to Article 96. The penalties provided for shall be effective, proportionate and dissuasive. They shall take into account the interests of SMEs, including start-ups, and their economic viability.
- The Member States shall, without delay and at the latest by the date of entry into application, notify the Commission of the rules on penalties and of other enforcement measures referred to in paragraph 1, and shall notify it, without delay, of any subsequent amendment to them.
- Non-compliance with the prohibition of the AI practices referred to in Article 5 shall be Error! Post not found for word:subject to administrative fines of up to 35.000.000 EUR or, if the offender is an Error! Post not found for word:undertaking, up to 7% of its total worldwide annual turnover for the preceding financial year, whichever is higher.
- Non-compliance with any of the following provisions related to Error! Post not found for word:operators or notified bodies, other than those laid down in Articles 5, shall be Error! Post not found for word:subject to administrative fines of up to 15.000.000 EUR or, if the offender is an Error! Post not found for word:undertaking, up to 3% of its total worldwide annual turnover for the preceding financial year, whichever is higher:
(a) obligations of Error! Post not found for word:providers pursuant to Article 16;
(b) obligations of authorised Error! Post not found for word:representatives pursuant to Article 22;
(c) obligations of Error! Post not found for word:importers pursuant to Article 23;
(d) obligations of Error! Post not found for word:distributors pursuant to Article 24;
(e) obligations of Error! Post not found for word:deployers pursuant to Article 26;
(f) requirements and obligations of notified bodies pursuant to Article 31, Article 33(1) and (4) or Article 34;
(g) transparency obligations for Error! Post not found for word:providers and Error! Post not found for word:deployers pursuant to Article 50.
- The supply of incorrect, incomplete or misleading information to notified bodies or national competent authorities in reply to a request shall be Error! Post not found for word:subject to administrative fines of up to 7.500.000 EUR or, if the offender is an Error! Post not found for word:undertaking, up to 1% of its total worldwide annual turnover for the preceding financial year, whichever is higher.
- In the case of SMEs, including start-ups, each fine referred to in this Article shall be up to the percentages or amount referred to in paragraphs 3, 4 and 5, whichever thereof is lower.
- When deciding whether to impose an administrative fine and when deciding on the amount of the administrative fine in each individual case, all relevant circumstances of the specific situation shall be taken into account and, as appropriate, regard shall be given to the following:
(a) the nature, gravity and duration of the infringement and of its consequences, taking into account the purpose of the Error! Post not found for word:ai system, as well as, where appropriate, the number of affected persons and the level of damage suffered by them;
(b) whether administrative fines have already been applied by other market surveillance authorities to the same Error! Post not found for word:operator for the same infringement;
(c) whether administrative fines have already been applied by other authorities to the same Error! Post not found for word:operator for infringements of other Union or national law, when such infringements result from the same activity or omission constituting a relevant infringement of this Regulation;
(d) the size, the annual turnover and market share of the Error! Post not found for word:operator committing the infringement;
(e) any other aggravating or mitigating factor applicable to the circumstances of the case, such as financial benefits gained, or losses avoided, directly or indirectly, from the infringement;
(f) the degree of cooperation with the national competent authorities, in order to remedy the infringement and mitigate the possible adverse effects of the infringement;
(g) the degree of responsibility of the Error! Post not found for word:operator taking into account the technical and organisational measures implemented by it;
(h) the manner in which the infringement became known to the national competent authorities, in particular whether, and if so to what extent, the Error! Post not found for word:operator notified the infringement;
(i) the intentional or negligent character of the infringement;
(j) any action taken by the Error! Post not found for word:operator to mitigate the harm suffered by the affected persons.
- Each Member State shall lay down rules on to what extent administrative fines may be imposed on public authorities and bodies established in that Member State.
- Depending on the legal system of the Member States, the rules on administrative fines may be applied in such a manner that the fines are imposed by competent national courts or by other bodies, as applicable in those Member States. The application of such rules in those Member States shall have an equivalent effect.
- The exercise of its powers under this Article shall be Error! Post not found for word:subject to appropriate procedural safeguards in accordance with Union and national law, including effective judicial remedies and due process.
- Member States shall, on an annual basis, report to the Commission about the administrative fines they have issued during that year, in accordance with this Article, and about any related litigation or judicial proceedings.
Article 100 – Administrative fines on Union institutions, bodies, offices and agencies
- The European Error! Post not found for word:data Protection Supervisor may impose administrative fines on Union institutions, bodies, offices and agencies falling within the scope of this Regulation. When deciding whether to impose an administrative fine and when deciding on the amount of the administrative fine in each individual case, all relevant circumstances of the specific situation shall be taken into account and due regard shall be given to the following:
(a) the nature, gravity and duration of the infringement and of its consequences; taking into account the purpose of the Error! Post not found for word:ai system concerned, as well as, where appropriate, the number of affected persons and the level of damage suffered by them;
(b) the degree of responsibility of the Union institution, body, office or agency, taking into account technical and organisational measures implemented by them;
(c) any action taken by the Union institution, body, office or agency to mitigate the damage suffered by affected persons;
(d) the degree of cooperation with the European Error! Post not found for word:data Protection Supervisor in order to remedy the infringement and mitigate the possible adverse effects of the infringement, including compliance with any of the measures previously ordered by the European Error! Post not found for word:data Protection Supervisor against the Union institution, body, office or agency concerned with regard to the same Error! Post not found for word:subject matter;
(e) any similar previous infringements by the Union institution, body, office or agency;
(f) the manner in which the infringement became known to the European Error! Post not found for word:data Protection Supervisor, in particular whether, and if so to what extent, the Union institution, body, office or agency notified the infringement;
(g) the annual budget of the Union institution, body, office or agency.
- Non-compliance with the prohibition of the AI practices referred to in Article 5 shall be Error! Post not found for word:subject to administrative fines of up to EUR 1.500.000.
- The non-compliance of the Error! Post not found for word:ai system with any requirements or obligations under this Regulation, other than those laid down in Article 5, shall be Error! Post not found for word:subject to administrative fines of up to EUR 750.000.
- Before taking decisions pursuant to this Article, the European Error! Post not found for word:data Protection Supervisor shall give the Union institution, body, office or agency which is the Error! Post not found for word:subject of the proceedings conducted by the European Error! Post not found for word:data Protection Supervisor the opportunity of being heard on the matter regarding the possible infringement. The European Error! Post not found for word:data Protection Supervisor shall base his or her decisions only on elements and circumstances on which the parties concerned have been able to comment. Complainants, if any, shall be associated closely with the proceedings.
- The rights of defence of the parties concerned shall be fully respected in the proceedings. They shall be entitled to have access to the European Error! Post not found for word:data Protection Supervisor’s file, Error! Post not found for word:subject to the legitimate interest of individuals or Error! Post not found for word:undertakings in the protection of their Error! Post not found for word:personal Error! Post not found for word:data or business secrets.
- Funds collected by imposition of fines in this Article shall contribute to the general budget of the Union. The fines shall not affect the effective operation of the Union institution, body, office or agency fined.
- The European Error! Post not found for word:data Protection Supervisor shall, on an annual basis, notify the Commission of the administrative fines it has imposed pursuant to this Article and of any litigation or judicial proceedings it has initiated.
Article 101 – Fines for providers of general-purpose AI models
- The Commission may impose on Error! Post not found for word:providers of general-purpose AI models fines not exceeding 3% of their annual total worldwide turnover in the preceding financial year or 15.000.000 EUR, whichever is higher., when the Commission finds that the Error! Post not found for word:provider intentionally or negligently:
(a) infringed the relevant provisions of this Regulation;
(b) failed to comply with a request for a document or for information pursuant to Article 91, or supplied incorrect, incomplete or misleading information;
(c) failed to comply with a measure requested under Article 93;
(d) failed to make available to the Commission access to the general-purpose AI model or general-purpose AI model with Error! Post not found for word:systemic Error! Post not found for word:risk with a view to conducting an evaluation pursuant to Article 92.
In fixing the amount of the fine or periodic penalty payment, regard shall be had to the nature, gravity and duration of the infringement, taking due account of the principles of proportionality and appropriateness. The Commission shall also into account commitments made in accordance with Article 93(3) or made in relevant codes of practice in accordance with Article 56.
- Before adopting the decision pursuant to paragraph 1, the Commission shall communicate its preliminary findings to the Error! Post not found for word:provider of the general-purpose AI model and give it an opportunity to be heard.
- Fines imposed in accordance with this Article shall be effective, proportionate and dissuasive.
- Information on fines imposed under this Article shall also be communicated to the Board as appropriate.
- The Court of Justice of the European Union shall have unlimited jurisdiction to review decisions of the Commission fixing a fine under this Article. It may cancel, reduce or increase the fine imposed.
- The Commission shall adopt implementing acts containing detailed arrangements and procedural safeguards for proceedings in view of the possible adoption of decisions pursuant to paragraph 1 of this Article. Those implementing acts shall be adopted in accordance with the examination procedure referred to in Article 98(2).
CHAPTER XIII – FINAL PROVISIONS
Article 102 – Amendment to Regulation (EC) No 300/2008
In Article 4(3) of Regulation (EC) No 300/2008, the following subparagraph is added:
‘When adopting detailed measures related to technical specifications and procedures for approval and use of security equipment concerning Artificial Intelligence systems within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council(*1), the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
Article 103 – Amendment to Regulation (EU) No 167/2013
In Article 17(5) of Regulation (EU) No 167/2013, the following subparagraph is added:
‘When adopting delegated acts pursuant to the first subparagraph concerning artificial intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council(*2), the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
Article 104 – Amendment to Regulation (EU) No 168/2013
In Article 22(5) of Regulation (EU) No 168/2013, the following subparagraph is added:
‘When adopting delegated acts pursuant to the first subparagraph concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council*(68), the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
Article 105 – Amendment to Directive 2014/90/EU
In Article 8 of Directive 2014/90/EU, the following paragraph is added:
‘5. For Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council(*4), when carrying out its activities pursuant to paragraph 1 and when adopting technical specifications and testing standards in accordance with paragraphs 2 and 3, the Commission shall take into account the requirements set out in Chapter III, Section 2 of that Regulation.
Article 106 – Amendment to Directive (EU) 2016/797
In Article 5 of Directive (EU) 2016/797, the following paragraph is added:”
‘12. When adopting delegated acts pursuant to paragraph 1 and implementing acts pursuant to paragraph 11 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council(*5), the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
Article 107 – Amendment to Regulation (EU) 2018/858
In Article 5 of Regulation (EU) 2018/858 the following paragraph is added:”
‘4. When adopting delegated acts pursuant to paragraph 3 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council(*6), the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
Article 108 – Amendment to Regulation (EU) 2018/1139
Regulation (EU) 2018/1139 is amended as follows:
(1) in Article 17, the following paragraph is added:
‘3. Without prejudice to paragraph 2, when adopting implementing acts pursuant to paragraph 1 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council(*7), the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
(2) in Article 19, the following paragraph is added:
‘4. When adopting delegated acts pursuant to paragraphs 1 and 2 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689, the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.’;
(3) in Article 43, the following paragraph is added:
‘4. When adopting implementing acts pursuant to paragraph 1 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689, the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.’;
(4) in Article 47, the following paragraph is added:
‘3. When adopting delegated acts pursuant to paragraphs 1 and 2 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689, the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.’;
(5) in Article 57, the following subparagraph is added:
‘When adopting those implementing acts concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689, the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.’;
(6) in Article 58, the following paragraph is added:
‘3. When adopting delegated acts pursuant to paragraphs 1 and 2 concerning Artificial Intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689, the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.’.”
Article 109 – Amendment to Regulation (EU) 2019/2144
In Article 11 of Regulation (EU) 2019/2144, the following paragraph is added:
‘3. When adopting the implementing acts pursuant to paragraph 2, concerning artificial intelligence systems which are safety components within the meaning of Regulation (EU) 2024/1689 of the European Parliament and of the Council, the requirements set out in Chapter III, Section 2 of that Regulation shall be taken into account.
Article 110 – Amendment to Directive (EU) 2020/1828
In Annex I to Directive (EU) 2020/1828 of the European Parliament and of the Council(77), the following point is added:
‘(68) Regulation (EU) 2024/1689 of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain Union legislative acts (OJ L, …, ELI: …)’.”
Article 111 – AI systems already placed on the market or put into service and general-purpose AI models already placed on the marked
- Without prejudice to the application of Article 5 as referred to in Article 113(3), point (a), Error! Post not found for word:ai systems which are components of the large-scale IT systems established by the legal acts listed in Annex X that have been placed on the market or put into service before 02 August 2027 shall be brought into compliance with this Regulation by 31 December 2030.
The requirements laid down in this Regulation shall be taken into account in the evaluation of each large-scale IT system established by the legal acts listed in Annex X to be undertaken as provided for in those legal acts and where those legal acts are replaced or amended.
- Without prejudice to the application of Article 5 as referred to in Article 113(3), point (a), this Regulation shall apply to Error! Post not found for word:operators of high-Error! Post not found for word:risk Error! Post not found for word:ai systems, other than the systems referred to in paragraph 1 of this Article, that have been placed on the market or put into service before 02 August 2026, only if, as from that date, those systems are Error! Post not found for word:subject to significant changes in their designs. In any case, the Error! Post not found for word:providers and Error! Post not found for word:deployers of high-Error! Post not found for word:risk Error! Post not found for word:ai systems intended to be used by public authorities shall take the necessary steps to comply with the requirements and obligations of this Regulation by 02 August 2030.
- Error! Post not found for word:providers of general-purpose AI models that have been placed on the market before 02 August 2025 shall take the necessary steps in order to comply with the obligations laid down in this Regulation by 02 August 2027.
Article 112 – Evaluation and review
- The Commission shall assess the need for amendment of the list set out in Annex III and of the list of prohibited AI practices laid down in Article 5, once a year following the entry into force of this Regulation, and until the end of the period of the delegation of power laid down in Article 97. The Commission shall submit the findings of that assessment to the European Parliament and the Council.
- By 02 August 2028 and every four years thereafter, the Commission shall evaluate and report to the European Parliament and to the Council on the following:
(a) the need for amendments extending existing area headings or adding new area headings in Annex III;
(b) amendments to the list of Error! Post not found for word:ai systems requiring additional transparency measures in Article 50;
(c) amendments enhancing the effectiveness of the supervision and governance system.
- By 02 August 2029 and every four years thereafter, the Commission shall submit a report on the evaluation and review of this Regulation to the European Parliament and to the Council. The report shall include an assessment with regard to the structure of enforcement and the possible need for a Union agency to resolve any identified shortcomings. On the basis of the findings, that report shall, where appropriate, be accompanied by a proposal for amendment of this Regulation. The reports shall be made public.
- The reports referred to in paragraph 2 shall pay specific attention to the following:
(a) the status of the financial, technical and human resources of the national competent authorities in order to effectively perform the tasks assigned to them under this Regulation;
(b) the state of penalties, in particular administrative fines as referred to in Article 99(1), applied by Member States for infringements of this Regulation;
(c) adopted harmonised standards and common specifications developed to support this Regulation;
(d) the number of Error! Post not found for word:undertakings that enter the market after the entry into application of this Regulation, and how many of them are SMEs.
- By 02 August 2028, the Commission shall evaluate the functioning of the Error! Post not found for word:ai office, whether the Office has been given sufficient powers and competences to fulfil its tasks and whether it would be relevant and needed for the proper implementation and enforcement of this Regulation to upgrade the Error! Post not found for word:ai office and its enforcement competences and to increase its resources. The Commission shall submit a report on its evaluation to the European Parliament and to the Council.
- By 02 August 2028, and every four years thereafter, the Commission shall submit a report on the review of the progress on the development of standardisation deliverables on the energy-efficient development of general-purpose AI models, and asses the need for further measures or actions, including binding measures or actions. The report shall be submitted to the European Parliament and to the Council, and it shall be made public.
- By 02 August 2028, and every three years thereafter, the Commission shall evaluate the impact and effectiveness of voluntary Error! Post not found for word:codes of conduct to foster the application of the requirements set out in Chapter III, Section 2 for Error! Post not found for word:ai systems other than high-Error! Post not found for word:risk Error! Post not found for word:ai systems and possibly other additional requirements for Error! Post not found for word:ai systems other than high-Error! Post not found for word:risk Error! Post not found for word:ai systems, including as regards environmental sustainability.
- For the purposes of paragraphs 1 to 7, the Board, the Member States and national competent authorities shall provide the Commission with information upon its request and without undue delay.
- In carrying out the evaluations and reviews referred to in paragraphs 1 to 7, the Commission shall take into account the positions and findings of the Board, of the European Parliament, of the Council, and of other relevant bodies or sources.
- The Commission shall, if necessary, submit appropriate proposals to amend this Regulation, in particular taking into account developments in technology, the effect of Error! Post not found for word:ai systems on health and safety, and on fundamental rights, and in light of the state of progress in the information society.
- To guide the evaluations and reviews referred to in paragraphs 1 to 7 of this Article, the Error! Post not found for word:ai office shall undertake to develop an objective and participative methodology for the evaluation of Error! Post not found for word:risk levels based on the criteria outlined in the relevant Articles and the inclusion of new systems in:
(a) the list set out in Annex III, including the extension of existing area headings or the addition of new area headings in that Annex;
(b) the list of prohibited practices set out in Article 5; and,
(c) the list of Error! Post not found for word:ai systems requiring additional transparency measures pursuant to Article 50.
- Any amendment to this Regulation pursuant to paragraph 10, or relevant delegated or implementing acts, which concerns sectoral Union harmonisation legislation listed in Section B of Annex I shall take into account the regulatory specificities of each sector, and the existing governance, conformity assessment and enforcement mechanisms and authorities established therein.
- By 02 August 2031, the Commission shall carry out an assessment of the enforcement of this Regulation and shall report on it to the European Parliament, the Council and the European Economic and Social Committee, taking into account the first years of application of this Regulation. On the basis of the findings, that report shall, where appropriate, be accompanied by a proposal for amendment of this Regulation with regard to the structure of enforcement and the need for a Union agency to resolve any identified shortcomings.
Article 113 – Entry into force and application
This Regulation shall enter into force on the twentieth day following that of its publication in the Official Journal of the European Union.
It shall apply from 02 August 2024.
However:
(a) Chapters I and [Chapter] II shall apply from 02 February 2025;
(b) Chapter III Section 4, Chapter V, Chapter VII and Chapter XII and Article 78 shall apply from 02 August 2025, with the exception of Article 101;
(c) Article 6(1) and the corresponding obligations in this Regulation shall apply from 02 August 2027.
This Regulation shall be binding in its entirety and directly applicable in all Member States.
Done at Brussels, 13 June 2024,
For the European Parliament – The President – R. METSOLA
For the Council – The President – M. MICHEL
ANNEX I – List of Union harmonisation legislation
Section A. List of Union harmonisation legislation based on the New Legislative Framework
- Directive 2006/42/EC of the European Parliament and of the Council of 17 May 2006 on machinery, and amending Directive 95/16/EC (OJ L 157, 9.6.2006, p. 24) [as repealed by the Machinery Regulation];
- Directive 2009/48/EC of the European Parliament and of the Council of 18 June 2009 on the safety of toys (OJ L 170, 30.6.2009, p. 1);
- Directive 2013/53/EU of the European Parliament and of the Council of 20 November 2013 on recreational craft and personal watercraft and repealing Directive 94/25/EC (OJ L 354, 28.12.2013, p. 90);
- Directive 2014/33/EU of the European Parliament and of the Council of 26 February 2014 on the harmonisation of the laws of the Member States relating to lifts and safety components for lifts (OJ L 96, 29.3.2014, p. 251);
- Directive 2014/34/EU of the European Parliament and of the Council of 26 February 2014 on the harmonisation of the laws of the Member States relating to equipment and protective systems intended for use in potentially explosive atmospheres (OJ L 96, 29.3.2014, p. 309);
- Directive 2014/53/EU of the European Parliament and of the Council of 16 April 2014 on the harmonisation of the laws of the Member States relating to the making available on the market of radio equipment and repealing Directive 1999/5/EC (OJ L 153, 22.5.2014, p. 62);
- Directive 2014/68/EU of the European Parliament and of the Council of 15 May 2014 on the harmonisation of the laws of the Member States relating to the making available on the market of pressure equipment (OJ L 189, 27.6.2014, p. 164);
- Regulation (EU) 2016/424 of the European Parliament and of the Council of 9 March 2016 on cableway installations and repealing Directive 2000/9/EC (OJ L 81, 31.3.2016, p. 1);
- Regulation (EU) 2016/425 of the European Parliament and of the Council of 9 March 2016 on personal protective equipment and repealing Council Directive 89/686/EEC (OJ L 81, 31.3.2016, p. 51);
- Regulation (EU) 2016/426 of the European Parliament and of the Council of 9 March 2016 on appliances burning gaseous fuels and repealing Directive 2009/142/EC (OJ L 81, 31.3.2016, p. 99);
- Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC (OJ L 117, 5.5.2017, p. 1);
- Regulation (EU) 2017/746 of the European Parliament and of the Council of 5 April 2017 on in vitro diagnostic medical devices and repealing Directive 98/79/EC and Commission Decision 2010/227/EU (OJ L 117, 5.5.2017, p. 176).
Section B. List of other Union harmonisation legislation
- Regulation (EC) No 300/2008 of the European Parliament and of the Council of 11 March 2008 on common rules in the field of civil aviation security and repealing Regulation (EC) No 2320/2002 (OJ L 97, 9.4.2008, p. 72);
- Regulation (EU) No 168/2013 of the European Parliament and of the Council of 15 January 2013 on the approval and market surveillance of two- or three-wheel vehicles and quadricycles (OJ L 60, 2.3.2013, p. 52);
- Regulation (EU) No 167/2013 of the European Parliament and of the Council of 5 February 2013 on the approval and market surveillance of agricultural and forestry vehicles (OJ L 60, 2.3.2013, p. 1);
- Directive 2014/90/EU of the European Parliament and of the Council of 23 July 2014 on marine equipment and repealing Council Directive 96/98/EC (OJ L 257, 28.8.2014, p. 146);
- Directive (EU) 2016/797 of the European Parliament and of the Council of 11 May 2016 on the Error! Post not found for word:interoperability of the rail system within the European Union (OJ L 138, 26.5.2016, p. 44);
- Regulation (EU) 2018/858 of the European Parliament and of the Council of 30 May 2018 on the approval and market surveillance of motor vehicles and their trailers, and of systems, components and separate technical units intended for such vehicles, amending Regulations (EC) No 715/2007 and (EC) No 595/2009 and repealing Directive 2007/46/EC (OJ L 151, 14.6.2018, p. 1);
- Regulation (EU) 2019/2144 of the European Parliament and of the Council of 27 November 2019 on type-approval requirements for motor vehicles and their trailers, and systems, components and separate technical units intended for such vehicles, as regards their general safety and the protection of vehicle occupants and vulnerable road users, amending Regulation (EU) 2018/858 of the European Parliament and of the Council and repealing Regulations (EC) No 78/2009, (EC) No 79/2009 and (EC) No 661/2009 of the European Parliament and of the Council and Commission Regulations (EC) No 631/2009, (EU) No 406/2010, (EU) No 672/2010, (EU) No 1003/2010, (EU) No 1005/2010, (EU) No 1008/2010, (EU) No 1009/2010, (EU) No 19/2011, (EU) No 109/2011, (EU) No 458/2011, (EU) No 65/2012, (EU) No 130/2012, (EU) No 347/2012, (EU) No 351/2012, (EU) No 1230/2012 and (EU) 2015/166 (OJ L 325, 16.12.2019, p. 1);
- Regulation (EU) 2018/1139 of the European Parliament and of the Council of 4 July 2018 on common rules in the field of civil aviation and establishing a European Union Aviation Safety Agency, and amending Regulations (EC) No 2111/2005, (EC) No 1008/2008, (EU) No 996/2010, (EU) No 376/2014 and Directives 2014/30/EU and 2014/53/EU of the European Parliament and of the Council, and repealing Regulations (EC) No 552/2004 and (EC) No 216/2008 of the European Parliament and of the Council and Council Regulation (EEC) No 3922/91 (OJ L 212, 22.8.2018, p. 1), in so far as the design, production and placing on the market of aircrafts referred to in Article 2(1), points (a) and (b) thereof, where it concerns unmanned aircraft and their engines, propellers, parts and equipment to control them remotely, are concerned.
ANNEX II – List of criminal offences referred to in Article 5(1), point (e)(iii)
Criminal offences referred to in Article 5(1), point (e)(iii):
- terrorism,
- trafficking in human beings,
- sexual exploitation of children, and child pornography,
- illicit trafficking in narcotic drugs or psychotropic substances,
- illicit trafficking in weapons, munitions or explosives,
- murder, grievous bodily injury,
- illicit trade in human organs or tissue,
- illicit trafficking in nuclear or radioactive materials,
- kidnapping, illegal restraint or hostage-taking,
- crimes within the jurisdiction of the International Criminal Court,
- unlawful seizure of aircraft or ships,
- rape,
- environmental crime,
- organised or armed robbery,
- sabotage,
- participation in a criminal organisation involved in one or more of the offences listed above.
ANNEX III -High-risk AI systems referred to in Article 6(2)
High-Error! Post not found for word:risk Error! Post not found for word:ai systems pursuant to Article 6(2) are the Error! Post not found for word:ai systems listed in any of the following areas:
- Biometrics, in so far as their use is permitted under relevant Union or national law:
(a) remote biometric identification systems.
This shall not include Error! Post not found for word:ai systems intended to be used for biometric verification the sole purpose of which is to confirm that a specific natural person is the person he or she claims to be;
(b) Error! Post not found for word:ai systems intended to be used for biometric categorisation, according to sensitive or protected attributes or characteristics based on the inference of those attributes or characteristics;
(c) Error! Post not found for word:ai systems intended to be used for emotion recognition.
(a) Error! Post not found for word:ai systems intended to be used as safety components in the management and operation of critical digital infrastructure, road traffic, or in the supply of water, gas, heating or electricity.
- Education and vocational training:
(a) Error! Post not found for word:ai systems intended to be used to determine access or admission or to assign natural persons to educational and vocational training institutions at all levels;
(b) Error! Post not found for word:ai systems intended to be used to evaluate learning outcomes, including when those outcomes are used to steer the learning process of natural persons in educational and vocational training institutions at all levels;
(c) Error! Post not found for word:ai systems intended to be used for the purpose of assessing the appropriate level of education that an individual will receive or will be able to access, in the context of or within educational and vocational training institutions;
(d) Error! Post not found for word:ai systems intended to be used for monitoring and detecting prohibited behaviour of students during tests in the context of or within educational and vocational training institutions.
- Employment, workers management and access to self-employment:
(a) Error! Post not found for word:ai systems intended to be used for the recruitment or selection of natural persons, in particular to place targeted job advertisements, to analyse and filter job applications, and to evaluate candidates;
(b) Error! Post not found for word:ai systems intended to be used to make decisions affecting terms of work-related relationships, the promotion or termination of work-related contractual relationships, to allocate tasks based on individual behaviour or personal traits or characteristics or to monitor and evaluate the performance and behaviour of persons in such relationships.
- Access to and enjoyment of essential private services and essential public services and benefits:
(a) Error! Post not found for word:ai systems intended to be used by public authorities or on behalf of public authorities to evaluate the eligibility of natural persons for essential public assistance benefits and services, including healthcare services, as well as to grant, reduce, revoke, or reclaim such benefits and services;
(b) Error! Post not found for word:ai systems intended to be used to evaluate the creditworthiness of natural persons or establish their credit score, with the exception of Error! Post not found for word:ai systems used for the purpose of detecting financial fraud;
(c) Error! Post not found for word:ai systems intended to be used for Error! Post not found for word:risk assessment and pricing in relation to natural persons in the case of life and health insurance;
(d) Error! Post not found for word:ai systems intended to evaluate and classify emergency calls by natural persons or to be used to dispatch, or to establish priority in the dispatching of, emergency first response services, including by police, firefighters and medical aid, as well as of emergency healthcare patient triage systems;
- Error! Post not found for word:law enforcement, in so far as their use is permitted under relevant Union or national law:
(a) Error! Post not found for word:ai systems intended to be used by or on behalf of Error! Post not found for word:law enforcement authorities, or by Union institutions, bodies, offices or agencies in support of Error! Post not found for word:law enforcement authorities or on their behalf to assess a natural person’s Error! Post not found for word:risk of becoming the victim of criminal offences;
(b) Error! Post not found for word:ai systems intended to be used by or on behalf of Error! Post not found for word:law enforcement authorities or by Union institutions, bodies, offices or agencies in support of Error! Post not found for word:law enforcement authorities as polygraphs or similar tools;
(c) Error! Post not found for word:ai systems intended to be used by or on behalf of Error! Post not found for word:law enforcement authorities, or by Union institutions, bodies, offices or agencies, in support of Error! Post not found for word:law enforcement authorities to evaluate the reliability of evidence in the course of the investigation or prosecution of criminal offences;
(d) Error! Post not found for word:ai systems intended to be used by Error! Post not found for word:law enforcement authorities or on their behalf or by Union institutions, bodies, offices or agencies in support of Error! Post not found for word:law enforcement authorities for assessing the likelihood of a natural person of offending or re-offending not solely based on Error! Post not found for word:profiling of natural persons as referred to in Article 3(4) of Directive (EU) 2016/680, or to assess personality traits and characteristics or past criminal behaviour of natural persons or groups;
(e) Error! Post not found for word:ai systems intended to be used by or on behalf of Error! Post not found for word:law enforcement authorities or by Union institutions, bodies, offices or agencies in support of Error! Post not found for word:law enforcement authorities for the Error! Post not found for word:profiling of natural persons as referred to in Article 3(4) of Directive (EU) 2016/680 in the course of the detection, investigation or prosecution of criminal offences.
- Migration, asylum and border control management, in so far as their use is permitted under relevant Union or national law:
(a) Error! Post not found for word:ai systems intended to be used by competent public authorities as polygraphs and similar tools;
(b) Error! Post not found for word:ai systems intended to be used by or on behalf of competent public authorities or by Union institutions, bodies, offices or agencies to assess a Error! Post not found for word:risk, including a security Error! Post not found for word:risk, a Error! Post not found for word:risk of irregular migration, or a health Error! Post not found for word:risk, posed by a natural person who intends to enter or who has entered into the territory of a Member State;
(c) Error! Post not found for word:ai systems intended to be used by or on behalf of competent public authorities or by Union institutions, bodies, offices or agencies to assist competent public authorities for the examination of applications for asylum, visa or residence permits and for associated complaints with regard to the eligibility of the natural persons applying for a status, including related assessments of the reliability of evidence;
(d) Error! Post not found for word:ai systems intended to be used by or on behalf of competent public authorities, including Union institutions, bodies, offices or agencies, in the context of migration, asylum or border control management, for the purpose of detecting, recognising or identifying natural persons, with the exception of the verification of travel documents.
- Administration of justice and democratic processes:
(a) Error! Post not found for word:ai systems intended to be used by a judicial authority or on their behalf to assist a judicial authority in researching and interpreting facts and the law and in applying the law to a concrete set of facts, or to be used in a similar way in alternative dispute resolution;
(b) Error! Post not found for word:ai systems intended to be used for influencing the outcome of an election or referendum or the voting behaviour of natural persons in the exercise of their vote in elections or referenda. This does not include Error! Post not found for word:ai systems to the output of which natural persons are not directly exposed, such as tools used to organise, optimise or structure political campaigns from an administrative or logistical point of view.
ANNEX IV – Technical documentation referred to in Article 11(1)
The technical documentation referred to in Article 11(1) shall contain at least the following information, as applicable to the relevant Error! Post not found for word:ai system:
- A general description of the Error! Post not found for word:ai system including:
(a) its Error! Post not found for word:intended purpose, the name of the Error! Post not found for word:provider and the version of the system reflecting its relation to previous versions;
(b) how the Error! Post not found for word:ai system interacts with, or can be used to interact with, Error! Post not found for word:hardware or Error! Post not found for word:software, including with other Error! Post not found for word:ai systems, that are not part of the Error! Post not found for word:ai system itself, where applicable;
(c) the versions of relevant Error! Post not found for word:software or firmware, and any requirements related to version updates;
(d) the description of all the forms in which the Error! Post not found for word:ai system is placed on the market or put into service, such as Error! Post not found for word:software packages embedded into Error! Post not found for word:hardware, downloads, or APIs;
(e) the description of the Error! Post not found for word:hardware on which the Error! Post not found for word:ai system is intended to run;
(f) where the Error! Post not found for word:ai system is a Error! Post not found for word:component of products, photographs or illustrations showing external features, the marking and internal layout of those products;
(g) a basic description of the Error! Post not found for word:user-interface provided to the Error! Post not found for word:deployer;
(h) instructions for use for the Error! Post not found for word:deployer, and a basic description of the Error! Post not found for word:user-interface provided to the Error! Post not found for word:deployer, where applicable;
- A detailed description of the elements of the Error! Post not found for word:ai system and of the process for its development, including:
(a) the methods and steps performed for the development of the Error! Post not found for word:ai system, including, where relevant, recourse to pre-trained systems or tools provided by third parties and how those were used, integrated or modified by the Error! Post not found for word:provider;
(b) the design specifications of the system, namely the general logic of the Error! Post not found for word:ai system and of the algorithms; the key design choices including the rationale and assumptions made, including with regard to persons or groups of persons in respect of who, the system is intended to be used; the main classification choices; what the system is designed to optimise for, and the relevance of the different parameters; the description of the expected output and output quality of the system; the decisions about any possible trade-off made regarding the technical solutions adopted to comply with the requirements set out in Chapter III, Section 2;
(c) the description of the system architecture explaining how Error! Post not found for word:software components build on or feed into each other and integrate into the overall Error! Post not found for word:processing; the computational resources used to develop, train, test and validate the Error! Post not found for word:ai system;
(d) where relevant, the Error! Post not found for word:data requirements in terms of datasheets describing the training methodologies and techniques and the Error! Post not found for word:training Error! Post not found for word:data sets used, including a general description of these Error! Post not found for word:data sets, information about their provenance, scope and main characteristics; how the Error! Post not found for word:data was obtained and selected; labelling procedures (e.g. for supervised learning), Error! Post not found for word:data cleaning methodologies (e.g. outliers detection);
(e) assessment of the human oversight measures needed in accordance with Article 14, including an assessment of the technical measures needed to facilitate the interpretation of the outputs of Error! Post not found for word:ai systems by the Error! Post not found for word:deployers, in accordance with Article 13(3), point (d);
(f) where applicable, a detailed description of pre-determined changes to the Error! Post not found for word:ai system and its performance, together with all the relevant information related to the technical solutions adopted to ensure continuous compliance of the Error! Post not found for word:ai system with the relevant requirements set out in Chapter III, Section 2;
(g) the validation and testing procedures used, including information about the validation and Error! Post not found for word:testing Error! Post not found for word:data used and their main characteristics; metrics used to measure Error! Post not found for word:accuracy, robustness and compliance with other relevant requirements set out in Chapter III, Section 2, as well as potentially discriminatory impacts; test logs and all test reports dated and signed by the responsible persons, including with regard to pre-determined changes as referred to under point (f);
(h) Error! Post not found for word:cybersecurity measures put in place;
- Detailed information about the monitoring, functioning and control of the Error! Post not found for word:ai system, in particular with regard to: its capabilities and limitations in performance, including the degrees of Error! Post not found for word:accuracy for specific persons or groups of persons on which the system is intended to be used and the overall expected level of Error! Post not found for word:accuracy in relation to its Error! Post not found for word:intended purpose; the foreseeable unintended outcomes and sources of risks to health and safety, fundamental rights and discrimination in view of the Error! Post not found for word:intended purpose of the Error! Post not found for word:ai system; the human oversight measures needed in accordance with Article 14, including the technical measures put in place to facilitate the interpretation of the outputs of Error! Post not found for word:ai systems by the Error! Post not found for word:deployers; specifications on Error! Post not found for word:input data, as appropriate;
- A description of the appropriateness of the performance metrics for the specific Error! Post not found for word:ai system;
- A detailed description of the Error! Post not found for word:risk management system in accordance with Article 9;
- A description of relevant changes made by the Error! Post not found for word:provider to the system through its lifecycle;
- A list of the harmonised standards applied in full or in part the references of which have been published in the Official Journal of the European Union; where no such harmonised standards have been applied, a detailed description of the solutions adopted to meet the requirements set out in Chapter III, Section 2, including a list of other relevant standards and technical specifications applied;
- A copy of the EU declaration of conformity;
- A detailed description of the system in place to evaluate the Error! Post not found for word:ai system performance in the post-market phase in accordance with Article 72, including the post-market monitoring plan referred to in Article 72(3).
ANNEX V – EU declaration of conformity
The EU declaration of conformity referred to in Article 47, shall contain all of the following information:
- Error! Post not found for word:ai system name and type and any additional unambiguous reference allowing the identification and traceability of the Error! Post not found for word:ai system;
- The name and address of the Error! Post not found for word:provider or, where applicable, of their authorised representative;
- A statement that the EU declaration of conformity is issued under the sole responsibility of the Error! Post not found for word:provider;
- A statement that the Error! Post not found for word:ai system is in conformity with this Regulation and, if applicable, with any other relevant Union law that provides for the issuing of an EU declaration of conformity;
- Where an Error! Post not found for word:ai system involves the Error! Post not found for word:processing of Error! Post not found for word:personal Error! Post not found for word:data, a statement that that Error! Post not found for word:ai system complies with Regulations (EU) 2016/679 and (EU) 2018/1725 and Directive (EU) 2016/680;
- References to any relevant harmonised standards used or any other common specification in relation to which conformity is declared;
- Where applicable, the name and identification number of the Error! Post not found for word:notified body, a description of the conformity assessment procedure performed, and identification of the certificate issued;
- The place and date of issue of the declaration, the name and function of the person who signed it, as well as an indication for, or on behalf of, whom that person signed, a signature.
ANNEX VI – Conformity assessment procedure based on internal control
- The conformity assessment procedure based on internal control is the conformity assessment procedure based on points 2 to 4.
- The Error! Post not found for word:provider verifies that the established quality management system is in compliance with the requirements of Article 17.
- The Error! Post not found for word:provider examines the information contained in the technical documentation in order to assess the compliance of the Error! Post not found for word:ai system with the relevant essential requirements set out in Chapter III, Section 2.
- The Error! Post not found for word:provider also verifies that the design and development process of the Error! Post not found for word:ai system and its post-market monitoring as referred to in Article 72 is consistent with the technical documentation.
ANNEX VII – Conformity based on an assessment of the quality management system and an assessment of the technical documentation
- Introduction
Conformity based on an assessment of the quality management system and an assessment of the technical documentation is the conformity assessment procedure based on points 2 to 5.
- Overview
The approved quality management system for the design, development and testing of Error! Post not found for word:ai systems pursuant to Article 17 shall be examined in accordance with point 3 and shall be Error! Post not found for word:subject to surveillance as specified in point 5. The technical documentation of the Error! Post not found for word:ai system shall be examined in accordance with point 4.
- Quality management system
3.1. The application of the Error! Post not found for word:provider shall include:
(a) the name and address of the Error! Post not found for word:provider and, if the application is lodged by an authorised representative, also their name and address;
(b) the list of Error! Post not found for word:ai systems covered under the same quality management system;
(c) the technical documentation for each Error! Post not found for word:ai system covered under the same quality management system;
(d) the documentation concerning the quality management system which shall cover all the aspects listed under Article 17;
(e) a description of the procedures in place to ensure that the quality management system remains adequate and effective;
(f) a written declaration that the same application has not been lodged with any other Error! Post not found for word:notified body.
3.2. The quality management system shall be assessed by the Error! Post not found for word:notified body, which shall determine whether it satisfies the requirements referred to in Article 17.
The decision shall be notified to the Error! Post not found for word:provider or its authorised representative.
The notification shall contain the conclusions of the assessment of the quality management system and the reasoned assessment decision.
3.3. The quality management system as approved shall continue to be implemented and maintained by the Error! Post not found for word:provider so that it remains adequate and efficient.
3.4. Any intended change to the approved quality management system or the list of Error! Post not found for word:ai systems covered by the latter shall be brought to the attention of the Error! Post not found for word:notified body by the Error! Post not found for word:provider.
The proposed changes shall be examined by the Error! Post not found for word:notified body, which shall decide whether the modified quality management system continues to satisfy the requirements referred to in point 3.2 or whether a reassessment is necessary.
The Error! Post not found for word:notified body shall notify the Error! Post not found for word:provider of its decision. The notification shall contain the conclusions of the examination of the changes and the reasoned assessment decision.
- Control of the technical documentation.
4.1. In addition to the application referred to in point 3, an application with a Error! Post not found for word:notified body of their choice shall be lodged by the Error! Post not found for word:provider for the assessment of the technical documentation relating to the Error! Post not found for word:ai system which the Error! Post not found for word:provider intends to place on the market or put into service and which is covered by the quality management system referred to under point 3.
4.2. The application shall include:
(a) the name and address of the Error! Post not found for word:provider;
(b) a written declaration that the same application has not been lodged with any other Error! Post not found for word:notified body;
(c) the technical documentation referred to in Annex IV.
4.3. The technical documentation shall be examined by the Error! Post not found for word:notified body. Where relevant and limited to what is necessary to fulfil its tasks, the Error! Post not found for word:notified body shall be granted full access to the training, validation, and Error! Post not found for word:testing Error! Post not found for word:data sets used, including, where appropriate and Error! Post not found for word:subject to security safeguards, through API or other relevant technical means and tools enabling remote access.
4.4. In examining the technical documentation, the Error! Post not found for word:notified body may require that the Error! Post not found for word:provider supply further evidence or carry out further tests so as to enable a proper assessment of the conformity of the Error! Post not found for word:ai system with the requirements set out in Chapter III, Section 2. Where the Error! Post not found for word:notified body is not satisfied with the tests carried out by the Error! Post not found for word:provider, the Error! Post not found for word:notified body shall itself directly carry out adequate tests, as appropriate.
4.5. Where necessary to assess the conformity of the high-Error! Post not found for word:risk Error! Post not found for word:ai system with the requirements set out in Chapter III, Section 2, after all other reasonable means to verify conformity have been exhausted and have proven to be insufficient, and upon a reasoned request, the Error! Post not found for word:notified body shall also be granted access to the training and trained models of the Error! Post not found for word:ai system, including its relevant parameters. Such access shall be Error! Post not found for word:subject to existing Union law on the protection of intellectual property and trade secrets.
4.6. The decision of the Error! Post not found for word:notified body shall be notified to the Error! Post not found for word:provider or its authorised representative. The notification shall contain the conclusions of the assessment of the technical documentation and the reasoned assessment decision.
Where the Error! Post not found for word:ai system is in conformity with the requirements set out in Chapter III, Section 2, the Error! Post not found for word:notified body shall issue a Union technical documentation assessment certificate. The certificate shall indicate the name and address of the Error! Post not found for word:provider, the conclusions of the examination, the conditions (if any) for its validity and the Error! Post not found for word:data necessary for the identification of the Error! Post not found for word:ai system.
The certificate and its annexes shall contain all relevant information to allow the conformity of the Error! Post not found for word:ai system to be evaluated, and to allow for control of the Error! Post not found for word:ai system while in use, where applicable.
Where the Error! Post not found for word:ai system is not in conformity with the requirements set out in Chapter III, Section 2, the Error! Post not found for word:notified body shall refuse to issue an Union technical documentation assessment certificate and shall inform the applicant accordingly, giving detailed reasons for its refusal.
Where the Error! Post not found for word:ai system does not meet the requirement relating to the Error! Post not found for word:data used to train it, re-training of the Error! Post not found for word:ai system will be needed prior to the application for a new conformity assessment. In this case, the reasoned assessment decision of the Error! Post not found for word:notified body refusing to issue the Union technical documentation assessment certificate shall contain specific considerations on the quality Error! Post not found for word:data used to train the Error! Post not found for word:ai system, in particular on the reasons for non-compliance.
4.7. Any change to the Error! Post not found for word:ai system that could affect the compliance of the Error! Post not found for word:ai system with the requirements or its Error! Post not found for word:intended purpose shall be assessed by the Error! Post not found for word:notified body which issued the Union technical documentation assessment certificate. The Error! Post not found for word:provider shall inform such Error! Post not found for word:notified body of its intention to introduce any of the abovementioned changes, or if it otherwise becomes aware of the occurrence of such changes. The intended changes shall be assessed by the Error! Post not found for word:notified body, which shall decide whether those changes require a new conformity assessment in accordance with Article 43(4) or whether they could be addressed by means of a supplement to the Union technical documentation assessment certificate. In the latter case, the Error! Post not found for word:notified body shall assess the changes, notify the Error! Post not found for word:provider of its decision and, where the changes are approved, issue to the Error! Post not found for word:provider a supplement to the Union technical documentation assessment certificate.
- Surveillance of the approved quality management system.
5.1. The purpose of the surveillance carried out by the Error! Post not found for word:notified body referred to in Point 3 is to make sure that the Error! Post not found for word:provider duly abides by the terms and conditions of the approved quality management system.
5.2. For assessment purposes, the Error! Post not found for word:provider shall allow the Error! Post not found for word:notified body to access the premises where the design, development, testing of the Error! Post not found for word:ai systems is taking place. The Error! Post not found for word:provider shall further share with the Error! Post not found for word:notified body all necessary information.
5.3. The Error! Post not found for word:notified body shall carry out periodic audits to make sure that the Error! Post not found for word:provider maintains and applies the quality management system and shall provide the Error! Post not found for word:provider with an audit report. In the context of those audits, the Error! Post not found for word:notified body may carry out additional tests of the Error! Post not found for word:ai systems for which a Union technical documentation assessment certificate was issued.
ANNEX VIII – Information to be submitted upon the registration of high-risk AI systems in accordance with Article 49
Section A – Information to be submitted by providers of high-risk AI systems in accordance with Article 49(1)
The following information shall be provided and thereafter kept up to date with regard to high-Error! Post not found for word:risk Error! Post not found for word:ai systems to be registered in accordance with Article 49(1):
- The name, address and contact details of the Error! Post not found for word:provider;
- Where submission of information is carried out by another person on behalf of the Error! Post not found for word:provider, the name, address and contact details of that person;
- The name, address and contact details of the authorised representative, where applicable;
- The Error! Post not found for word:ai system trade name and any additional unambiguous reference allowing the identification and traceability of the Error! Post not found for word:ai system;
- A description of the Error! Post not found for word:intended purpose of the Error! Post not found for word:ai system and of the components and functions supported through this Error! Post not found for word:ai system;
- A basic and concise description of the information used by the system (Error! Post not found for word:data, inputs) and its operating logic;
- The status of the Error! Post not found for word:ai system (on the market, or in service; no longer placed on the market/in service, recalled);
- The type, number and expiry date of the certificate issued by the Error! Post not found for word:notified body and the name or identification number of that Error! Post not found for word:notified body, where applicable;
- A scanned copy of the certificate referred to in point 8, where applicable;
- Any Member States in which the Error! Post not found for word:ai system was on the market, was put into service or made available in the Union;
- A copy of the EU declaration of conformity referred to in Article 47;
- Electronic instructions for use; this information shall not be provided for high-Error! Post not found for word:risk Error! Post not found for word:ai systems in the areas of Error! Post not found for word:law enforcement or migration, asylum and border control management referred to in Annex III, points 1, 6 and 7;
- A URL for additional information (optional).
Section B – Information to be submitted by providers of high-risk AI systems in accordance with Article 49(2)
The following information shall be provided and thereafter kept up to date with regard to Error! Post not found for word:ai systems to be registered in accordance with Article 49(2):
- The name, address and contact details of the Error! Post not found for word:provider;
- Where submission of information is carried out by another person on behalf of the Error! Post not found for word:provider, the name, address and contact details of that person;
- The name, address and contact details of the authorised representative, where applicable;
- The Error! Post not found for word:ai system trade name and any additional unambiguous reference allowing the identification and traceability of the Error! Post not found for word:ai system;
- A description of the Error! Post not found for word:intended purpose of the Error! Post not found for word:ai system;
- The condition or conditions under in Article 6(3) based on which the Error! Post not found for word:ai system is considered to be not-high-Error! Post not found for word:risk;
- A short summary of the grounds on which the Error! Post not found for word:ai system is considered to be not-high-Error! Post not found for word:risk in application of the procedure under Article 6(3);
- The status of the Error! Post not found for word:ai system (on the market, or in service; no longer placed on the market/in service, recalled);
- Any Member States in which the Error! Post not found for word:ai system has been placed on the market, put into service or made available in the Union.
Section C – Information to be submitted by deployers of high-risk AI systems in accordance with Article 49(3)
The following information shall be provided and thereafter kept up to date with regard to high-Error! Post not found for word:risk Error! Post not found for word:ai systems to be registered in accordance with Article 49:
- The name, address and contact details of the Error! Post not found for word:deployer;
- The name, address and contact details of the person submitting information on behalf of the Error! Post not found for word:deployer;
- A summary of the findings of the fundamental rights impact assessment conducted in accordance with Article 27;
- The URL of the entry of the Error! Post not found for word:ai system in the EU database by its Error! Post not found for word:provider;
- A summary of the data protection impact assessment carried out in accordance with Article 35 of Regulation (EU) 2016/679 or Article 27 of Directive (EU) 2016/680 as specified in Article 26(8) of this Regulation, where applicable.
ANNEX IX – Information to be submitted upon the registration of high-risk AI systems listed in Annex III in relation to testing in real world conditions in accordance with Article 60
The following information shall be provided and thereafter kept up to date with regard to testing in real world conditions to be registered in accordance with Article 60:
- A Union-wide unique single identification number of the testing in real world conditions;
- The name and contact details of the Error! Post not found for word:provider or prospective Error! Post not found for word:provider and of the Error! Post not found for word:deployers involved in the testing in real world conditions;
- A brief description of the Error! Post not found for word:ai system, its Error! Post not found for word:intended purpose, and other information necessary for the identification of the system;
- A summary of the main characteristics of the plan for testing in real world conditions;
- Information on the suspension or termination of the testing in real world conditions.
ANNEX X Union legislative acts on large-scale IT systems in the area of Freedom, Security and Justice
1. Schengen Information System
(a) Regulation (EU) 2018/1860 of the European Parliament and of the Council of 28 November 2018 on the use of the Schengen Information System for the return of illegally staying third-country nationals (OJ L 312, 7.12.2018, p. 1).
(b) Regulation (EU) 2018/1861 of the European Parliament and of the Council of 28 November 2018 on the establishment, operation and use of the Schengen Information System (SIS) in the field of border checks, and amending the Convention implementing the Schengen Agreement, and amending and repealing Regulation (EC) No 1987/2006 (OJ L 312, 7.12.2018, p. 14).
(c) Regulation (EU) 2018/1862 of the European Parliament and of the Council of 28 November 2018 on the establishment, operation and use of the Schengen Information System (SIS) in the field of police cooperation and judicial cooperation in criminal matters, amending and repealing Council Decision 2007/533/JHA, and repealing Regulation (EC) No 1986/2006 of the European Parliament and of the Council and Commission Decision 2010/261/EU (OJ L 312, 7.12.2018, p. 56).
2. Visa Information System
(a) Regulation (EU) 2021/1133 of the European Parliament and of the Council of 7 July 2021 amending Regulations (EU) No 603/2013, (EU) 2016/794, (EU) 2018/1862, (EU) 2019/816 and (EU) 2019/818 as regards the establishment of the conditions for accessing other EU information systems for the purposes of the Visa Information System (OJ L 248, 13.7.2021, p. 1).
(b) Regulation (EU) 2021/1134 of the European Parliament and of the Council of 7 July 2021 amending Regulations (EC) No 767/2008, (EC) No 810/2009, (EU) 2016/399, (EU) 2017/2226, (EU) 2018/1240, (EU) 2018/1860, (EU) 2018/1861, (EU) 2019/817 and (EU) 2019/1896 of the European Parliament and of the Council and repealing Council Decisions 2004/512/EC and 2008/633/JHA, for the purpose of reforming the Visa Information System (OJ L 248, 13.7.2021, p. 11).
3. Eurodac
Regulation (EU) 2024/1358 of the European Parliament and of the Council of 14 May 2024 on the establishment of ‘Eurodac’ for the comparison of Error! Post not found for word:biometric Error! Post not found for word:data in order to effectively apply Regulations (EU) 2024/1315 and (EU) 2024/1350 of the European Parliament and of the Council and Council Directive 2001/55/EC and to identify illegally staying third-country nationals and stateless persons and on requests for the comparison with Eurodac Error! Post not found for word:data by Member States’ Error! Post not found for word:law enforcement authorities and Europol for Error! Post not found for word:law enforcement purposes, amending Regulations (EU) 2018/1240 and (EU) 2019/818 of the European Parliament and of the Council and repealing Regulation (EU) No 603/2013 of the European Parliament and of the Council (OJ L, 2024/1358, 22.5.2024, ELI: http://Error! Post not found for word:data.europa.eu/eli/reg/2024/1358/oj).
4. Entry/Exit System
Regulation (EU) 2017/2226 of the European Parliament and of the Council of 30 November 2017 establishing an Entry/Exit System (EES) to register entry and exit Error! Post not found for word:data and refusal of entry Error! Post not found for word:data of third-country nationals crossing the external borders of the Member States and determining the conditions for access to the EES for Error! Post not found for word:law enforcement purposes, and amending the Convention implementing the Schengen Agreement and Regulations (EC) No 767/2008 and (EU) No 1077/2011 (OJ L 327, 9.12.2017, p. 20).
5. European Travel Information and Authorisation System
(a) Regulation (EU) 2018/1240 of the European Parliament and of the Council of 12 September 2018 establishing a European Travel Information and Authorisation System (ETIAS) and amending Regulations (EU) No 1077/2011, (EU) No 515/2014, (EU) 2016/399, (EU) 2016/1624 and (EU) 2017/2226 (OJ L 236, 19.9.2018, p. 1).
(b) Regulation (EU) 2018/1241 of the European Parliament and of the Council of 12 September 2018 amending Regulation (EU) 2016/794 for the purpose of establishing a European Travel Information and Authorisation System (ETIAS) (OJ L 236, 19.9.2018, p. 72).
6. European Criminal Records Information System on third-country nationals and stateless persons
Regulation (EU) 2019/816 of the European Parliament and of the Council of 17 April 2019 establishing a centralised system for the identification of Member States holding conviction information on third-country nationals and stateless persons (ECRIS-TCN) to supplement the European Criminal Records Information System and amending Regulation (EU) 2018/1726 (OJ L 135, 22.5.2019, p. 1).
7. Error! Post not found for word:interoperability
(a) Regulation (EU) 2019/817 of the European Parliament and of the Council of 20 May 2019 on establishing a framework for Error! Post not found for word:interoperability between EU information systems in the field of borders and visa and amending Regulations (EC) No 767/2008, (EU) 2016/399, (EU) 2017/2226, (EU) 2018/1240, (EU) 2018/1726 and (EU) 2018/1861 of the European Parliament and of the Council and Council Decisions 2004/512/EC and 2008/633/JHA (OJ L 135, 22.5.2019, p. 27).
(b) Regulation (EU) 2019/818 of the European Parliament and of the Council of 20 May 2019 on establishing a framework for Error! Post not found for word:interoperability between EU information systems in the field of police and judicial cooperation, asylum and migration and amending Regulations (EU) 2018/1726, (EU) 2018/1862 and (EU) 2019/816 (OJ L 135, 22.5.2019, p. 85).
ANNEX XI – Technical documentation referred to in Article 53(1), point (a) — technical documentation for providers of general-purpose AI models
Section 1 – Information to be provided by all providers of general-purpose AI models
The technical documentation referred to in Article 53(1), point (a) shall contain at least the following information as appropriate to the size and Error! Post not found for word:risk profile of the model:
1. A general description of the general-purpose AI model including:
(a) the tasks that the model is intended to perform and the type and nature of Error! Post not found for word:ai systems in which it can be integrated;
(b) the acceptable use policies applicable;
(c) the date of release and methods of distribution;
(d) the architecture and number of parameters;
(e) the modality (e.g. text, image) and format of inputs and outputs;
(f) the licence.
2. A detailed description of the elements of the model referred to in point 1, and relevant information of the process for the development, including the following elements:
(a) the technical means (e.g. instructions of use, infrastructure, tools) required for the general-purpose AI model to be integrated in Error! Post not found for word:ai systems;
(b) the design specifications of the model and training process, including training methodologies and techniques, the key design choices including the rationale and assumptions made; what the model is designed to optimise for and the relevance of the different parameters, as applicable;
(c) information on the Error! Post not found for word:data used for training, testing and validation, where applicable, including the type and provenance of Error! Post not found for word:data and curation methodologies (e.g. cleaning, filtering, etc.), the number of Error! Post not found for word:data points, their scope and main characteristics; how the Error! Post not found for word:data was obtained and selected as well as all other measures to detect the unsuitability of Error! Post not found for word:data sources and methods to detect identifiable biases, where applicable;
(d) the computational resources used to train the model (e.g. number of floating point operations), training time, and other relevant details related to the training;
(e) known or estimated energy consumption of the model.
With regard to point (e), where the energy consumption of the model is unknown, the energy consumption may be based on information about computational resources used.
Section 2 – Additional information to be provided by providers of general-purpose AI models with systemic risk
1. A detailed description of the evaluation strategies, including evaluation results, on the basis of available public evaluation protocols and tools or otherwise of other evaluation methodologies. Evaluation strategies shall include evaluation criteria, metrics and the methodology on the identification of limitations.
2. Where applicable, a detailed description of the measures put in place for the purpose of conducting internal and/or external adversarial testing (e.g. red teaming), model adaptations, including alignment and fine-tuning.
3. Where applicable, a detailed description of the system architecture explaining how Error! Post not found for word:software components build or feed into each other and integrate into the overall Error! Post not found for word:processing.
ANNEX XII – Transparency information referred to in Article 53(1), point (b) — technical documentation for providers of general-purpose AI models to downstream providers that integrate the model into their AI system
The information referred to in Article 53(1), point (b) shall contain at least the following:
1. A general description of the general-purpose AI model including:
(a) the tasks that the model is intended to perform and the type and nature of Error! Post not found for word:ai systems into which it can be integrated;
(b) the acceptable use policies applicable;
(c) the date of release and methods of distribution;
(d) how the model interacts, or can be used to interact, with Error! Post not found for word:hardware or Error! Post not found for word:software that is not part of the model itself, where applicable;
(e) the versions of relevant Error! Post not found for word:software related to the use of the general-purpose AI model, where applicable;
(f) the architecture and number of parameters;
(g) the modality (e.g. text, image) and format of inputs and outputs;
(h) the licence for the model.
2. A description of the elements of the model and of the process for its development, including:
(a) the technical means (e.g. instructions for use, infrastructure, tools) required for the general-purpose AI model to be integrated into Error! Post not found for word:ai systems;
(b) the modality (e.g. text, image, etc.) and format of the inputs and outputs and their maximum size (e.g. context window length, etc.);
(c) information on the Error! Post not found for word:data used for training, testing and validation, where applicable, including the type and provenance of Error! Post not found for word:data and curation methodologies.
ANNEX XIII – Criteria for the designation of general-purpose AI models with systemic risk referred to in Article 51
For the purpose of determining that a general-purpose AI model has capabilities or an impact equivalent to those set out in Article 51(1), point (a), the Commission shall take into account the following criteria:
(a) the number of parameters of the model;
(b) the quality or size of the Error! Post not found for word:data set, for example measured through tokens;
(c) the amount of computation used for training the model, measured in floating point operations or indicated by a combination of other variables such as estimated cost of training, estimated time required for the training, or estimated energy consumption for the training;
(d) the input and output modalities of the model, such as text to text (large language models), text to image, multi-modality, and the state of the art thresholds for determining high-impact capabilities for each modality, and the specific type of inputs and outputs (e.g. biological sequences);
(e) the benchmarks and evaluations of capabilities of the model, including considering the number of tasks without additional training, adaptability to learn new, distinct tasks, its level of autonomy and scalability, the tools it has access to;
(f) whether it has a high impact on the internal market due to its reach, which shall be presumed when it has been made available to at least 10 000 registered business users established in the Union;
(g) the number of registered end-users.
